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A SYSTEM AND METHOD FOR PROVIDING AN INTELLIGENT 
MULTI-STEP DIALOG WITH A USER 

Related Applications 

This application claims priority to the following applications: 

U.S. Provisional Application No. 60/187,472, entitled "System and Method for 

Producing an Intelligent Multi-Step Dialog with a User," filed March 6, 2000, bearing 

attorney docket no. 07569-6002-00000. 

Field of the Invention 
This invention relates to systems and methods for retrieving information, and 

more particularly to systems and methods for providing a multi-step conversation-like 

interaction between a person and a computer or other device to refine and satisfy the 

person's request for information. 

Background 

A key resource of most, if not all enterprises is knowledge. For example, in a 
customer service environment, customers expect prompt and correct answers to their 
information requests. These information requests may relate to problems with 
products the customer has purchased, or to questions about products they may decide 
to purchase in the future. In most cases, the answer to the customer's question exists 
somewhere within the enterprise. In other cases, the answer may have existed in the 
enterprise at one time, but is no longer there. The challenge is to find the best answer 
and provide it to the customer in a timely manner. 

Typical approaches to providing support information to customers on the 
Internet, either provide a static structure (predefined hyperlinks) for customers to 
navigate to the information they need, or they provide simple "lookup" facilities for 
finding documents or products, such as database searches or full-text searches for 
keywords appearing in documents or in product descriptions. These types of 
approaches are typically not tailored to the customer (no personalization) and do not 
typically engage the customer in a multiple step interaction (no conversational dialog), 
wherein the information is elicited from the customer 

Other current approaches for providing support information to customers, such 
as case-based reasoning systems and expert systems, provide a multiple step 
interaction with customers, but they require the business to set up very complex "case" 
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structures or expert-system rule sets that define the problems and their resolutions in 
great detail. These approaches are often brittle, and it is typically very costly for the 
business to add new rules and cases to these systems. 

Still other Web-based systems check for particular textual content without the 
advantage of context or domain knowledge. Consequently, they generally do not 
reliably and consistently return the desired information. This is at least partly due to 
the fact that language is not only inherently ambiguous, but also because it is 
susceptible to expressing a single concept any number of ways using numerous and 
unrelated words and/or phrases. By simply searching for specific key words, prior art 
search engines fail to identify other alternatives that may also be helpful. 

Consequently, there is a strong need in the art for an improved method and 
apparatus for retrieving relevant information from large knowledge bases. There is 
also a need for providing this capability to relatively unsophisticated users. 

Summary of the Invention 

The present invention satisfies the above-described need by providing a system 
and method for efficiently retrieving information from a large knowledge base. More 
specifically, the present invention uses a fairly simple set of knowledge structures to 
represent the domain of problems to be discussed with the customers. New documents 
describing problem resolutions, product descriptions, etc., can be either manually or 
automatically placed into these knowledge structures. Users' interests, backgrounds, 
etc., can also be represented using these same structures. Once the knowledge 
structure is populated, businesses can write fairly simple navigation rules that allow 
the invention to engage customers in a rich, personalized dialog. 

The present invention supports a model of interaction between a machine and a 
human being that closely models the way people interact with each other. It allows the 
user to begin with an incomplete problem description, and elicits the unstated elements 
of the description- which the user may not know at the beginning of the interaction, or 
may not know are important-asking only questions that are relevant to the problem 
description stated so far, given the system's knowledge of the problem domain; 
without requiring the user to answer questions one at a time, or to answer all of the 
questions posed; and without imposing unnecessary restrictions on the order in which 
questions are posed to the user. The present invention allows the dialog designer to 
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model the way an expert elicits information, giving a human feel to the dialog and a 
better customer experience. 

In one embodiment, the present invention is an application program running on 
a server accessed via the world-wide web or other data network using standard 
Internet protocols, a web browser and web server software. In operation, users start a 
dialog by directing their web browser to a designated web page. This web page asks 
the user some initial questions that are then passed to a dialog engine. The dialog 
engine then applies its methods and algorithms to a knowledge map, using dialog 
control information\ and the user's responses to provide feedback to the user. The 
feedback may include follow-up questions, relevant documents, and instructions to the 
user (e.g., instructions to contact a human customer service representative). This 
dialog engine response is rendered as a web page and returned to the user's web 
browser. The user can then respond further to the follow-up questions he or she is 
presented, and the cycle repeats. 

The invention can be implemented so that it can interact with customers 
through a wide variety of communication channels including the Internet, wireless 
devices (e.g., telephone, pager, etc.), handheld devices such as a Personal Data 
Assistant (PDA), email, and via a telephone where the automated system is delivered 
using an interactive voice response (IVR) and/or speech-recognition system. 

Additional features and advantages of the invention will be set forth in the 
description which follows, and in part will be apparent from the description, or may be 
learned by practice of the invention. The objectives and other advantages of the 
invention will be realized and attained by the methods, systems, and apparatus 
particularly pointed out in the written description and claims hereof, as well as the 
appended drawings. 

It is to be understood that both the foregoing general description and the 
following detailed description are exemplary and explanatory and are intended to 
provide further explanation of the invention as claimed. 

Brief Description of the Drawings 

The accompanying drawings, which are incorporated in and constitute a part of 
this specification, illustrate embodiments of the invention and, together with the 
description, serve to explain the objects, advantages, and principles of the invention. 
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In the drawings 

Fig. 1 is a block diagram of a network including an arrangement constructed 
in accordance with the subject invention for providing a multi-step interactive dialog 
over a network; 

Fig. 2 is a more detailed block diagram of a client computing device of Figure 

A; 

Fig. 3 is a more detailed block diagram of a dialog engine server of Figure A; 

Fig. 4 is drawing illustrating the relationship between knowledge containers, 
taxonomies and taxonomy tags in accordance with an embodiment of the present 
invention; 

Fig. 5 shows one embodiment of knowledge containers that include five main 
components; 

Fig. 6 is a drawing illustrating taxonomies for troubleshooting printer 
problems; 

Fig. 7 is a drawing illustrating basic constraints in accordance with an 
embodiment of the present invention; 

Fig. 8 is a drawing illustrating negated constraints in accordance with an 
embodiment of the present invention; 

Fig. 9 is a drawing illustrating conditional constraints in accordance with an 
embodiment of the present invention; 

Fig. 10 is a drawing illustrating triggers in accordance with an embodiment of 
the present invention; 

Fig. 1 1 is a drawing illustrating the goal resolution process in accordance with 
an embodiment of the present invention; 

Fig. 12 is a drawing illustrating the goal unification process in accordance with 
an embodiment of the present invention; 

Figs. 13 is a chart illustrating the different categories of follow-up questions in 
accordance with an embodiment of the present invention; 

Fig. 14 shows a step in the interactive dialogue where the user can choose 
among the taxonomies; 

Fig. 15 is a chart illustrating a text question in accordance with an embodiment 
of the present invention; 
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Fig. 16 is a chart illustrating a document driven question in accordance with an 
embodiment of the present invention; 

Fig. 1 7 is a chart illustrating a parameterized question- in accordance with an 
embodiment of the present invention; 

FIG. 18 is a flow chart showing the operation of the multi-step interactive 
dialog system in a manner consistent with the present invention; and 

Figs. 19-21 are drawings illustrating atypical dialog. 

Detailed Description 

In the following detailed description of one embodiment, reference is made to 
the accompanying drawings that form a part thereof, and in which is shown by way of 
illustration a specific embodiment in which the invention may be practiced. This 
embodiment is described in sufficient detail to enable those skilled in the art to 
practice the invention and it is to be understood that other embodiments may be 
utilized and that structural changes may be made without departing from the scope of 
the present invention. The following detailed description is, therefore, not to be taken 
in a limited sense. 

A system in accordance with the present invention is directed to a system 
(generically, an "e-service portal") and method for the delivery of information 
resources including electronic content (documents, online communities, software 
applications, etc.) and physical sources (experts within the company, other customers, 
etc.) to end-users. In order to further convey a complete understanding of the present 
system, the following overview is provided: 
OVERVIEW 

The purpose of a Dialog Engine is to facilitate the following in an electronic 
interaction between a human being and a machine (computer or other device including 
for example a telephone or Personal Data Assistant): 

a. ) Find and deliver an appropriate set of Knowledge Containers (as defined in 

previous filings) to the human; 

b. ) Find and route the human to an appropriate web service (see definitions) or 

human expert; 



5 



WO 01/67225 



PCTYUS01/07056 



c. ) Encapsulate the interaction between a human and a machine in the form of 

a meta-data representation relating to a knowledge map (knowledge 
session); 

d. ) Deliver the knowledge session to other applications via API, XML or any 

other form; 

The Dialog Engine of the present invention is designed to construct a "knowledge 
session" in the context of a Knowledge Map (as described Appendix A). 
A knowledge session is a representation of a user's situation or scenario in the context 
of a knowledge map. A knowledge session includes text elicited from the user and a 
collection of tags (as described in Appendix A) that each represent a link to a concept 
node within the knowledge map and a "weight" indicating the strength of that link. 
The Dialog engine is a machine for knowledge session management defined by at least 
the following operations: the ability to accept inputs, the ability to interface to 
inference engines, the ability to construct interactions, and the ability to send sessions 
to other software. 

The knowledge engine of the present invention is defined by: 

1 . ) The Dialog Engine creates the knowledge session through a plurality of input 

types. 

2. ) The Dialog Engine acts on these input types by interacting with a plurality of 

inference engines. 

3. ) The Dialog engine refines the session via a plurality of interaction forms. 

4. ) The Dialog engine may output sessions to search engines (or other 

applications) in the form of a markup language based representation (e.g., 
XML or HTML, etc.) of the knowledge session. 

Input Types: 

The Dialog Engine builds a knowledge session using a plurality of input: 
The context of a user's entry into the present system (Entry Context); 
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The autocontextualization (classification into a knowledge map, as described in 
Appendix A) of a natural language text ("a question") entered by the user (Question 
Context); 

The customer data or profile maintained about a user (User Context); 

The responses by the user to queries posed by the Dialog Engine (Dialog Context); 

Choices made in respect to the common ground (see definitions) (Common Ground 

Context); 

The choices/actions made by the user during the dialog (such as selecting a document) 
(Interaction Context). 

User Entry : 

The Dialog engine can utilize the context of a user's "entry" into the present 
system environment in the form of: 

a. ) the link the user traversed to enter the system; 

b. ) an XML (or other markup) packet describing the user's situation (a 

form, a meta-data collection); 

c. ) a blob of text describing the users situation which can be 

autocontextualized. 
Each of these inputs is mapped to the knowledge map to create tags. 

Natural Language : 

The Dialog engine can elicit from the user a statement of the user's 
problem, issue, or request in the form of keywords or natural language. This is the 
user's "question". This natural language is converted into a set of tags using the 
autocontextualization process. 

Profile 

User "profiles" can come in the form of: 

a. ) a structured data record obtained from a Customer Relationship 

Management (CRM) or customer database; 

b. ) a packet containing meta-data in the form of tags; 
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c.) a User Knowledge container (as described in co-pending U.S. Patent 
Application No. 09/594,083). 
Each of these inputs is mapped to the Kanisa knowledge map to create tags. 

Dialog Response 

The Dialog engine interacts with users to create and refine the knowledge 
session tags. The Dialog engine utilizes a range of interaction forms (described 
below) to elicit additional information from the user. 

System Interactions 

The user makes choices and selections during the dialog interaction not 
specifically associated with the dialog itself. These selections include: 

a. ) browser interactions (e.g. choosing the back button); 

b. ) interactions with documents (e.g. choosing to view a Knowledge 

container); 

c. ) interactions with GUI elements. 

Each of these inputs can be translated into inferences in relationship to the knowledge 
map. 

Inference Engine Interaction : 
Dialog Engine Drivers 

The Dialog Engine can be driven by one or more "inference engines" (e.g., a standard 
rules engine, a standard classification engine, and the Kanisa autocontextualization 
engine.) 

The Dialog Engine can support some or all of the following interaction forms: 

1 . ) Popular or Parameterized Queries (PQ) 

2. ) Drill Down Queries (DDQ) or Clarifying Queries (CQ) 

3. ) Discriminating Queries (DQ) 

4. ) Disambiguating Queries (DAQs) 
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These four interaction forms represent the set of logical mechanisms for taking an 
initial session state as defined by 1 or more of the 3 initial forms of context. These 
initial forms are the Entry Context, the Question Context and the User Context. 
Interaction Forms are designed to build Dialog Context from the combination of the 
three initial contexts (as bound together in the Knowledge Session State). The goal of 
the interaction forms is to support a logical and intuitive way to enable the human 
(user) to tell the machine (dialog engine) "more", in order to assist the machine in 
expanding and refining the session state so as to better perform the functions of the 
dialog engine (see Overview). 

The four logical interaction forms are: 

Parameterized or Popular Queries (PQs): One obvious response to a user question is 
to determine whether it is, in fact, analogous/equivalent to a question for which there 
is a well-known answer. In human conversation, this is captured by: "So, are you 
really asking, X?". X is a restatement of the question in terms understood by the 
responder. The responder asks the query in this way to ensure that a possible known 
"answer" is really relevant (that is, the user is actually asking the question which is the 
predicate of the answer). 

In the dialog engine, PQs are specific "pre-created" queries that are' played to the user 
when the session state matches the conditions necessary for the PQ to be appropriate. 
For example, suppose that a PQ (PQ: 1245 containing query: "Are you receiving an 
error message #101 when installing for the first time?", options: YES/NO and answer: 
KC EXTERNALID.001) is mapped within the knowledge map to the Activity 
taxonomy: First Time Install and to the Symptom Taxonpmy: Error Message. If the 
user asks the questions "I'm getting an error when installing the software", and this 
autocontextualizes to the Activity Taxonomy: First Time Install, Symptom Taxonomy: 
Eiror Message, Object Taxonomy: Software, then the Dialog Engine will play the PQ 
to the user. If the user answers Yes, the answer will be displayed. If the user answers 
no, the answer will not be displayed. The user's answer changes the session state by 
emphasizing the importance of the tags mapped to the PQ. 
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DDQ or CQ: The DDQ interaction form utilizes the information contained in the 
knowledge map to structure a query. In its simplest form, the goal of the DDQ is to 
utilize the "shape" of a taxonomy to obtain additional information. If a user asks 
"How do I install Windows", and the Dialog engine recognizes that Windows is a 
reference to a concept node called the Windows OS and the Windows OS concept has 
taxonomic children called Windows 95, Windows 98 and Windows 2000, then the 
Dialog engine can/will ask: 

Are you asking about: 

Windows 95 
Windows 98, or 
Windows 2000. 

The user selection will change the session state by refining the meta-tag Windows to 
the meta-tag Window 95 (or whatever is chosen by the user). In short, a DDQ utilizes 
the knowledge contained in the knowledge map (and typically within one taxonomy or 
KR that is a constituent of the knowledge map) to elicit a finer grained understanding 
of the session. 

A DDQ may utilize one or more of the following knowledge map elements to structure 
the options associated with the DDQ: 

a. ) parent-child relationship within a taxonomy; 

b. ) sibling relationship within a taxonomy; 

c. ) pattern similarity across concept node evidence vectors 

d. ) the type of relationship link connecting concept nodes. 

A DQ (Discriminating Query) is designed to discriminate between the knowledge 
containers remaining in the search space. This query emanates from the meta-data 
associated with the individual KCs in the search space. The Dialog engine looks to 
see if it can discriminate between KCs based on asking the user to choose between 
alternative concepts relevant to the KCs still "alive" in the search space given the 
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current session state. So, if the KCs in the search space have different tags within the 
same taxonomy, the Dialog Engine might ask the user to choose which of these 
competing concepts was actually relevant. For example, if some KCs are tagged to 
"first-time installation", others to "re-installation" and still others to the activity 
"deactivation", the query would ask the user to discriminate interest in these 
competing concepts. The effect of the DQ is to simultaneously eliminate tags from the 
search space while strengthening others. 

DAQs (disambiguating queries) use the mapping between the user's text and tags 
derived from it and\or relationships between tags in the knowledge session to identify 
ambiguity in the session state associated with the user question or between the various 
forms of context collection. DAQs are queries formulated to highlight this ambiguity 
and to ask the user to disambiguate by making a clear choice between the potential 
interpretations. 

Several forms of DAQs are part of the Kanisa Dialog Engine: 

Evidence Vector DAQs: Identified by a "term" (as defined in co-pending U.S. Patent 
Application No. 09/594,083, entitled "System and Method for Implementing a 
Knowledge Management System,") that is evidence for multiple concept nodes. For 
example "ATM" is evidence for the concept Asynchronous Tranfer Mode and 
Automatic Teller Machine. 

Knowledge Map DAQs: Identified by Tags that are ambiguous according to the 
semantics of relationships within the knowledge map such as sharing a common 
ancestor whose descendants should be exclusive. 

Text DAQs: Identified by characteristics of the user's text, such as misspellings or 
ambiguity of words in the text (as defined by an external machine-readable dictionary, 
thesaurus, or lexicon, e.g., WordNet), or by a lack of information in the 
autocontextualization engine about words in the text. 
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Combination DAQs: DAQs that use two or more of the above sources of information 
about ambiguity. 
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Query Graphical User Interface fGUD Forms: 



The Dialog Engine can utilize any or all of the following question forms, as 
appropriate, as the GUI for user interaction: 

Open Ended Questions: Text Box 
Multiple Choice Questions: List Box 
Open + Choice: Combo Box 
Option Questions: Radio Button 
Multiple Option Questions: Check Box 

The GUI presentation of a query to a user is independent of the interaction form. That 
is, an interaction form may, in different instances, utilize a different GUI form. GUI 
forms are simply the set of presentation options provided by the computer 
environment or operating system. Unlike the interaction form, they are external to the 
Dialog Engine. 

Outputs 
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The Dialog Engine outputs session states in one or more formats. 
These formats include: 

An XML (or other markup language) representation. 

A dialog record (click stream log). 

A Web form. 

The Session State output contains some or all of the following: 

Tag Records: Concept-Node Name, Weight, Context Type (as discussed above) 
Question String: user input text 

Dialog Action Records: Dialog Action Type, Sequence ID, KC External ID 
Search Space Record: KC External ID, Weight, Rank 

Search Query String: text formulated by Search Engine to produce the Search Space 

Interaction with Search and Retrieval Engines and Web Services 

The Dialog Engine is designed to work with any prior art search/retrieval engines to 
produce a Search Space. The Search Space is the set of specific knowledge containers 
"in play" based on the session state. The Search Space is a function of the session- 
state, but a given search/retrieval engine will manufacture a different search space 
based on its specific algorithm for translating the search space into a "query string", 
and its own algorithm for retrieving a KC or document from an index based on a query 
string. 

The Dialog engine is designed to interact with Web Services. This interaction can be 
thin or thick based on support for a variety of interface methods such as: 

URL: PQ 

API 

Dynamic URL: GPQ 
XML: WebForm. 

The Dialog Engine's competence to interact with Web Services enables it to guide 
people to the full range of Web-enabled resources. 
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Internal Workings: 

Control Language 

The Dialog Engine recognizes and processes any of a plurality of 
control languages (e.g., KTX control language). A Kanisa Taxonomy (KTX) 
Language Manual (Version 2) (Appendix B) describes all of the features, syntax and 
limitations of this control language. 

Variable Termination 

The Dialog engine terminates its interaction with the user based on a 
variety of conditions. For example: 

a. ) exhaustion of goals defined by the control language; 

b. ) exhaustion of goals emanating from the knowledge map; 

c. ) reduction of the search space below a size threshold associated 

with interaction termination; 

d. ) user opts out; 

e. ) web session times out 

f. ) 

No Answers/Not Relevant Answers 

The dialog engine processes user inputs to the Queries not only in the 
form of positive selections, but also in the form of implicit or negative selections. 
These include situations where the user chooses to skip the question, or when the user 
chooses options such as "None of the Above" or "Irrelevant". 

Definitions: 

User: A person creating a session with the Dialog Engine. 

Knowledge Container: A combination of content and meta-data in the form of tags to 
a knowledge map. 

Web Service: A software application accessible by URL or XML. 
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Common Ground: a representation of a knowledge session that may be displayed to a 
user to show how the Dialog Engine interprets the information elicited from the user 
or inferred during dialog processing and that may be modified by the user in order to 
correct or change the Dialog Engine's interpretation. 

Knowledge Map: A structured representation (model) of the real world encapsulated 
in a set of classifications and linked by relationships or rules. 

Interaction Form: A standard mechanism for eliciting additional information from an 
application user by automatically generating a query. 

Knowledge Session: An interaction between a human and a Dialog Engine as 
mediated through a knowledge map. 

Knowledge Session State (also known as "dialog state"): The aggregate set of meta- 
data (tags), text and dialog information that encapsulates the known facts about a 
knowledge session. 

Question: The natural language text communicated by a user to the Dialog Engine. 

Query: An interaction form combined with a GUI representation on a screen sent by 
the Dialog Engine to the user. 

Search Space: The set of Knowledge containers passed to the Dialog Engine by a 
Search/Retrieval Engine as potentially useful given the Session State. 

Query String: The query string used by a search engine to retrieve knowledge 
containers or document records. 

Turning now to the nomenclature of the specification, the detailed description 
which follows is represented largely in terms of processes and symbolic 
representations of operations performed by conventional computer components, 
including a central processing unit (CPU), memory storage devices for the CPU, and 



15 



WO 01/67225 



PCTAJS01/07056 



connected pixel-oriented display devices. These operations include the manipulation 
of data bits by the CPU and the maintenance of these bits within data structures 
residing in one or more of the memory storage devices. Such data structures impose a 
physical organization upon the collection of data bits stored within computer memory 
and represent specific electrical or magnetic elements. These symbolic representations 
are the means used by those skilled in the art of computer programming and computer 
construction to most effectively convey teachings and discoveries to others skilled in 
the art. 

For the purposes of this discussion, a process is generally conceived to be a 
sequence of computer-executed steps leading to a desired result. These steps generally 
require physical manipulations of physical quantities. Usually, though not necessarily, 
these quantities take the form of electrical, magnetic, or optical signals capable of 
being stored, transferred, combined, compared, or otherwise manipulated. It is 
conventional for those skilled in the art to refer to these signals as bits, values, 
elements, symbols, characters, terms, objects, numbers, records, files or the like. It 
should be kept in mind, however, that these and similar terms should be associated 
with appropriate physical quantities for computer operations, and that these terms are 
merely conventional labels applied to physical quantities that exist within and during 
operation of the computer. 

It should also be understood that manipulations within the computer are often 
referred to in terms such as adding, comparing, moving, etc., which are often 
associated with manual operations performed by a human operator. It must be 
understood that no such involvement of a human operator is necessary or even 
desirable in the present invention. The operations described herein are machine 
operations performed in conjunction with a human operator or user who interacts with 
the computer. The machines used for performing the operation of the present 
invention include general purpose digital computers or other similar computing 
devices. 

In addition, it should be understood that the programs, processes, methods, etc. 
described herein are not related or limited to any particular computer or apparatus. 
Rather, various types of general purpose machines may be used with programs 
constructed in accordance with the teachings described herein. Similarly, it may prove 
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advantageous to construct specialized apparatus to perform the method steps described 
herein by way of dedicated computer systems with hard-wired logic or programs 
stored in nonvolatile memory, such as read only memory. 

The operating environment in which the present invention is used encompasses 
general distributed computing systems wherein general purpose computers, work 
stations, or personal computers are connected via communication links of various 
types. In a client server arrangement, programs and data, many in the form of objects, 
are made available by various members of the system. 

Referring now to the figures, corresponding reference characters refer to 
corresponding elements, wherever possible. Like many systems of knowledge 
representation, the present invention represents and stores both the individual 
instances of information, and the concepts that can be used to organize these instances 
(i.e., single concepts that can be associated with multiple instances). 

Referring now to the drawings, FIG. 1 illustrates a network 10 for 
implementing the subject invention. As shown in FIG. 1, network 10 is comprised of 
thin client computing devices 2 (PDAs and cellular telephones), analog or digital 
telephones 4, desktop or laptop client computing devices 12, facsimile machines 16, 
gateways 18, extranets 22 and servers 24 coupled to a public network 20. Digital 
telephones 4, client computing devices 12, facsimile machines 16, gateways 18, 
extranets 22 and servers 24 are coupled to public network 20 via a conventional 
interface 32. As shown in FIG. 1, thin client computing devices 2 are coupled to 
gateway 1 8 via a wireless interface 34. Each telephone 4 is a conventional analog or 
digital telephone that communicates with other analog and digital telephones over a 
public-switched telephone network (PSTN). Client computing devices 12 may be 
directly connected to public network 20, or they may be coupled to the public network 
20 via gateway 18. Gateway 18 is a file server that may be connected to other 
computers on the public network 20. Company extranet 22 is a smaller private 
network that may be separated from other computers on public network by a firewall. 
Coupled to company extranet 22 are a plurality of server computers 24. 

In one embodiment of the present invention, the public network 20 is the 
Internet. Thus, before describing the operation of the system of the present invention 
(described below in connection with FIG. 18), it would be helpful to briefly discuss 
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the basic functionality of the Internet as it relates to the system of the present 
invention. The Internet is well known in the art as a worldwide data network of 
various computer systems and other data networks of varying size. Connection to the 
Internet may be accomplished via standard phone lines or via dedicated 
high-throughput communications lines such as Integrated Services Digital Network 
(ISDN) and Tl . The functionality of the Internet as a data communication medium is 
well known and encompasses a broad range of applications. One such application is 
the World Wide Web (WWW). The WWW is a subset of the Internet which allows 
computers connected to the Internet to access interactive programs called Web sites 
located on other Internet-connected computers by entering a unique "address" 
associated with a particular Web site. Because of their interactive features, Web sites 
are ideal for both distributing and gathering information. Most importantly, a 
particular computer's Web site may be linked to and may control other programs 
stored on the same or on another computer connected to the Internet For example, a 
Web site describing a company's products and services may be stored in a company 
extranet 22 and accessed via the public network 20 (in this case, the Internet) by a 
customer using the client computing device (2 and 12) or telephone 4. 

The customer may view information about the company provided by the Web 
site, and may also use the Web site's interactive features to place a request for more 
information from the company or for technical support for the company's product. 
The Web site may also cause another program stored in the company extranet 22 to 
select other programs in response to the customer's request. This, and other features of 
the Internet make it preferable as the public network 20 in accordance with the system / 
of the present invention. 

As shown in FIG. 2, client computing device (2 and 12) is further comprised of 
a central processor unit (CPU) 101, a memory 102, a display adapter 106, a display 
108, a user interface (UI) adapter 1 10, a pointing device 1 1 1, a keyboard 1 12, an 
input/output (IO) adapter 1 14, a disk storage unit 115, and a communications adapter 
1 20. Client computing devices (2 and 12) enable a customer to access company 
extranet 22 via the public network 20 in order to request information about a 

company's products or services or receive assistance from the company's customer^ 

support representatives located at dialog engine server 24. Client computing device 12 
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is preferably connected to public network 20 via network interface cable 32 (e.g., a 
standard phone line or a high throughput telecommunication medium such as an ISDN 
line or a Tl line) for enabling bi-directional data communications with other computer 
systems connected to public network 20. Thin client computing device 2 is preferably 
connected to public network 20 via wireless data link 34 and gateway 1 8. Thin client 
computing devices 2, as is commonly known by those skilled in the art, usually consist 
of less capable processors and smaller memories than desktop and laptop clients. 
Memory 102 includes an operating system 130 for operating the device and a browser 
program 132 for rendering and displaying content. As shown, the various components 
of each client device (2 and 12) communicate through a system bus 1 13 or similar 
architecture. FIG. 2 also shows that communications adaptor 120 is coupled to 
network interface cable 32 ( or wireless data link 34) for providing connectivity 
between client computer (2 and 12) and public network 20. There may be other 
components as well, but these are not shown to facilitate description of the unique 
aspects of this embodiment of the invention. The hardware arrangement of this 
computer, as well as the other computers discussed in this specification is intentionally 
shown as general, and is meant to represent a broad variety of architectures, which 
depend on the particular computing device used. 

FIG. 3 shows a detailed diagram of a dialog engine server 24 in accordance . 
with one embodiment of the present invention. As shown, dialog engine server 24 is 
comprised of a CPU 201, a display adapter 206, a display 208, a UI adapter 210, a 
pointing device 21 1, a keyboard 212, an IO adapter 214, a disk storage unit 215, a 
communications adapter 220 and a network interface cable 32. Dialog engine server 
24 also has a memory 202 for storing an operating system 230 which controls its 
operation, dialog engine 232 for retrieving content, a knowledge map 234, and dialog 
control information 236. Dialog engine 232 uses a knowledge map 234 and dialog 
control information 236 , to produce dialogs with users in the domain of knowledge 
map 234. One or more people called "dialog designers" create the knowledge map, 
including user profile information and documents, and the dialog control information 
that is loaded into memory 202 of server 24. Dialog designers also use dialog engine 
232 to set goals, create triggers (rules), stored questions (PQs), and us»er preferences 
that retrieve information from knowledge map 10 and control the end-user's 



19 



WO 01/67225 



PCT/US01/07056 



experience. After the dialog designers have created the knowledge map and dialog 
control information, and loaded it into memory 202, dialog engine 232 is ready to 
have dialogs with users about the domain of the knowledge map. 

While FIG. 3 depicts dialog engine server 24 as a single computer, those 
skilled in the art will appreciate that it may also be a distributed computer system, such 
as a LAN, with the capabilities described above. As in the case of client computing 
devices 12, dialog engine server 24 is preferably connected to public network 20 via a 
high throughput telecommunication medium, such as an ISDN line or Tl line for 
enabling bi-directional data communication with other computer systems also 
connected to public network 20. A connection to public network 20 via a high 
throughput telecommunication medium is particularly advantageous for dialog engine 
server 24 because it provides sufficient bandwidth to handle a large number of 
accesses by other computer systems concurrently connected to dialog engine server 24 
via the company extranet 22 and public network 20, such as client computing device 
12. 

In the above system, the interaction between computers is achieved using a 
"client-server" software architecture in which a client program contacts a dialog 
engine server 24 through any software communication mechanism or protocol. In 
another embodiment, dialog engine 232 and the user interface program 132 can be the 
same program. A similar type of interaction can be achieved using a portable device 
such as a WAP cellular telephone, Palm Pilot, or alphanumeric pager as the client in 
which the user views and responds to information that comes from a dialog engine 
server. 

In some embodiments, a similar type of interaction can be achieved vocally via 
an interactive voice response (IVR) type of system. In these embodiments, the user 
speaks their requests and responses into telephone 4 or other microphone, and may 
also provide other input by pressing buttons (e.g. buttons on the telephone's keypad). 
The user's spoken responses are passed to a voice recognition system, which turns the 
responses into data that dialog engine 232 can process. The dialog engine 232 
response is passed to a text-to-speech system that turns it into a vocal response to the 
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In yet another embodiment, the data format that is used to encode "requests" to 
the dialog engine (whether to start a new dialog or to pass user responses back to 
dialog engine) and the data format used to encode the dialog engine's responses, is in 
extensible Markup Language (XML) format. XML is a standard data format syntax 
adopted by the World Wide Web Consortium (W3C). Commonly available software 
exists to take XML-encoded data and a "style sheet" encoded in XSL (extensible 
Stylesheet Language), and combine them to render HTML (HyperText Markup 
Language), which is the display format that web browser software can display. The 
advantage of this approach is that for the dialog designers to create new "looks" for 
users using the dialog engine via a web browser, all that is required is changing the 
XSL stylesheet to produce the desired HTML. 

It should be appreciated from the schematic overview illustrated by FIG. 1, and 
the detailed schematics of FIGs. B - C that the present invention may be employed in a 
distributed computer system environment which has internal, external and intranet 
networks collectively represented in the schematic overview by public network 20 to 
connect: PDAs 2, telephones 4, clients 12, and gateways 18 to World Wide Web 
servers and dialog engine servers 24 within the system in which the present invention 
is situated. 

Thus far, this description has focused on the design and architecture of an 
exemplary network 10 for implementing the subject invention. The next portion of the 
description will describe the process for resolving an inquiry initiated by a user at a 
client workstation on network 10. More specifically, when a user at one of the client 
devices (PDAs 2, telephones 4, clients 12) poses a question to dialog engine server 24, 
a multi-step interactive dialog as explained below, occurs between the user and dialog 
engine 232. 

The two main components for implementing a dialog with a user are a dialog 
engine and a knowledge map. To resolve the user's question, dialog engine 232 
interprets the question, poses other questions to the user and then interprets the user's 
answers to eliminate irrelevant concept nodes and traverse a knowledge map as it 
focuses in on an answer to the user's question. FIG. 4 depicts a knowledge map 10 for 

organizing-various dimensions of-information. As shown in FIG. 4, knowledge map — 

10 is comprised of knowledge containers 20, taxonomies 30 and taxonomy tags 40. 
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Knowledge containers 20 are individual instances of information that may be 
associated with one or more taxonomies 30 through the use of one or more taxonomy 
tags 40. 

As shown in FIG. 5, each knowledge container is comprised of administrative 
meta-data 50, context tags 60, marked content 70, original content 80 and links 90. 
Administrative meta-data 50 is a set of structured fields that hold typed information 
about the knowledge container, including who created it, who last modified it, for 
whom it was created, its title, a short "synopsis" or description, a Uniform Resource 
Locator (URL) for reaching the original version of the content (if applicable), the 
name of the publication the content appeared in (if applicable), etc. The knowledge 
container 20 contains the original electronic form of the original content 80 (perhaps a 
Microsoft Word document, a PDF file, an HTML page, a pointer to it, or both). This 
allows the knowledge container 20 to be displayed to the end user in its complete and 
original form if desired. In some embodiments, the list of administrative meta-data 
attributes is extensible, so each different enterprise that deploys the system may add 
fields that it desires and/or needs. 

Context tags or taxonomy tags 60 represent a multidimensional classification 
of the knowledge container against a knowledge map, as depicted in FIG. 4. Such a 
classification puts the knowledge container 20 in context within a knowledge domain. 
Each taxonomy tag 60 includes the name or other unique identifier of a concept node 
within a taxonomy 30 optionally followed by a number, typically between 0 and 1, 
which indicates the knowledge container's strength of association with that concept 
node. The taxonomy tag 60 also includes an attribution (not shown) which records 
whether the tag was created by a person, or automatically by the system using 
autocontextualization (as described in Appendix A). There is no restriction on the 
number of taxonomies to which a knowledge container may be tagged, or the number 
of concept nodes within a taxonomy to which the knowledge container is tagged. 

As stated earlier, knowledge containers are merely instances of information 
resources. Organizing these instances into comprehensive representations of 
information is accomplished through the use of taxonomies 30. An example of a 

taxonomy that details various hardware and software components and vendors is 

shown in FIG. 6. As shown, taxonomy 30 consists of a plurality of root nodes 300, a 
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plurality of concept nodes 310 coupled together by a plurality of edges 320. Each 
node 300, 310 in a taxonomy expresses a "concept," or a classification to which 
content and resources can be assigned. The set of nodes 300, 310 for each taxonomy 
is created to model the taxonomy's area of concern at an appropriate level for 
distinguishing among the correct knowledge containers to return: neither too coarse a 
representation which fails to differentiate among many knowledge containers, nor too 
granular a representation which models more distinctions than really exist among 
available knowledge containers. Consequently, node 300, 310 may have zero or more 
children. Node 300, 3 1 0 may also contain references or taxonomy tags 40 to the 
knowledge containers 20 that are classified to it. These references may be accessible 
either from the knowledge containers they classify (in which case it can be used to 
identify the concept node the knowledge container is classified to) or from the concept 
node to which the knowledge container is classified (in which case it can be used to 
identify the knowledge container). 

Node 300, 310 may have one or more triggers associated with it. In the present 
invention, dialog control logic is expressed through the use of triggers which consists 
of a label, a condition, an event and an action. When an event occurs, triggers 
associated with the event are evaluated. If the trigger condition is satisfied, the action 
is taken. Below is an example of a simple trigger: 

If(under(al2,ts)) { confirm(a3); } 
The left hand side of the trigger is a condition "If (under(al2, ts))" and the right hand 
side is an event or action "{ confirm(a3); }". As shown, the trigger's condition 
consists of the keyword "if* followed by a left parenthesis, a Boolean expression of 
one or more predicates, and then a right parenthesis. A single predicate may have the 
form "Condition (concept, concept set)." These concept sets include: 

- topic spotter concepts that have been automatically derived from any text entered 
by the user of the dialog. The automatic derivation of concepts can be 
accomplished using statistical text classification algorithms, as described in greater 
detail in Appendix A; 

- confirmed concepts that have been confirmed as accepted nodes in the current 
dialog, either because they were entered by users in response to follow-up 
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questions, or because they were confirmed by executing a trigger action that 
performs that function; 

- profile concepts that are associated with the user of the dialog. These concepts 
may indicate the user's interests, expertise level, demographics, previous 
purchases, entitlements to receive particular information, documents, or services; 
or any other data about the user; 

- preferred concepts that are preferred over other concepts in the same taxonomy, 
for the current dialog. These "dialog preferences" may be specified as part of a 
goal declaration or a trigger action declaration, and be created when the goal is 
created or the trigger action is executed; and 

- other concepts that may be created and manipulated via executing trigger actions. 

For any of these sets, a test in a trigger condition may test whether any or all 
members of the set satisfy specified predicates. Possible predicates fall into 3 
categories: basic, negated, and conditional. The basic predicates are: AT, UNDER, 
and PATH. As shown in FIG. 7, the AT predicate (V10) limits relevant areas of the 
knowledge map to the specified concept node and restricts documents to those 
documents that are tagged to the specified concept node. The UNDER predicate 
(V20) limits the relevant areas of the knowledge map to the descendants of the 
specified concept node in the taxonomy tree and the node itself. It restricts documents 
to those tagged to the node or one of its descendants. The PATH predicate (V30) 
limits the relevant area of the knowledge map to a specified node, its ancestors and 
descendants in the taxonomy tree. The PATH predicate likewise restricts documents 
to those tagged to the node, its ancestors and descendants. Other basic predicates 
include: ABOVE - restricts relevant areas of the knowledge map to nodes that are 
"above" the specified node within the knowledge map; CONTAINS-ONE-OF - 
restricts relevant areas of the knowledge map to nodes that contain at least one of the 
nodes in the list of nodes; CONTAINS-ALL-OF - restricts relevant areas of the 
knowledge map to all of the nodes in the list of specified nodes; PREFERENCE - 
restricts relevant areas of the knowledge map to the set of preferred nodes in the dialog 
engine state (previously accepted nodes for goals with constraint type 
PREFERENCE); LEAF - true if the specified node is a leaf node; ROOT - true if the 
specified node is a taxonomy root; PARENT - true if the specified node has child 
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nodes; and HAS-DOCUMENTS - true if any available documents are tagged to the 
specified node. The negated predicates are: NOT-AT and NOT-UNDER. As shown 
in FIG. 8, the NOT-AT predicate (W10) limits the relevant area of the knowledge map 
to everything but the specified node. It also excludes documents tagged to the 
specified node from the result list. The NOT-UNDER predicate (W20) limits relevant 
areas of the knowledge map to everything but the specified node and its descendants. 
The NOT-UNDER predicate also excludes documents tagged to the specified node or 
its descendants from the result. Referring now to FIG. 9, it is shown that the 
conditional predicates are: UNDER-IF-TAGGED and PATH-IF-TAGGED. The 
UNDER-IF-TAGGED predicate (X10) limits relevant areas of the knowledge map to 
the specified node and it's descendants. It restricts the document set to documents 
tagged to the specified node and its descendants plus documents that are not tagged to 
the taxonomy of the specified node at all. In other words, UNDER-IF-TAGGED 
restricts away all documents tagged anywhere in the taxonomy, but the node specified 
or it's descendants. The PATH-IF-TAGGED predicate (X20) limits relevant areas of 
the knowledge map to a specified node, its ancestors and descendants. The PATH-IF- 
TAGGED predicate also restricts documents to those tagged to the node, its ancestors 
or descendants, plus all documents that are not tagged to the taxonomy. While the 
sample trigger above shows one predicate, it is important to realize that the Boolean 
expression may consist of more predicates connected with the operators "and" and 
"or". In operation, trigger conditions test various parts of the current state of the 
dialog. The Boolean expression and each of the tests, evaluate (true or false) the 
current state of the dialog. If the Boolean expression is true, then the list of actions of 
the trigger is executed. In one embodiment, trigger conditions are optional within 
each trigger. A trigger with no conditions is equivalent to having a trigger condition 
that always evaluates to "true". That is, if no trigger conditions are present, the action 
list of the trigger is executed when the triggering event occurs. The actions performed 
when a trigger is executed can change the current state of the dialog in such a way as 
to affect the response that is returned to the user. In addition to tests on concepts 
and concept sets, trigger conditions can test any other element of the state of the 
current dialog, such as: ~- 
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- iteration number: the number of responses that have been passed back and forth 
between the dialog engine and the user. (Predicates on the iteration number would 
include equals, greater than, and less than); 

- meta data about the user: tests on any known meta-data about the user of the 
current dialog; for example, greater-than(age of user, 30); 

- number of documents "remaining" that may still be applicable to the current 
dialog. As the dialog progresses, some of the documents in the total set of 
documents may be "eliminated" from consideration as a document to ever be 
returned to the user during the current dialog, due to constraints created as the 
dialog proceeds. Predicates can test the number of documents still remaining that 
may be returned to the user; and 

- goal resolution: trigger conditions may test whether a particular goal has been 
resolved at this point in the current dialog; and how that goal has been resolved 
(e.g. was it resolved by user input; information found in the user's profile; or by a 
declaration that the taxonomy is irrelevant). 

When the triggering condition is evaluated as "true", the event associated with 
the trigger is executed. A triggering event is an event that changes the current state of 
the dialog. In general, any event that changes the current state of the dialog - either 
caused by a user input, by the action of a trigger, or by the dialog engine itself - can 
act as a triggering event. Each triggering event can have a set of zero or more triggers 
associated with it, that are evaluated when the event occurs. These include: 

• Every iteration - A "default" triggering event that occurs every dialog 
iteration (that is, every time a dialog request/response is received from the 
user's client software by the dialog engine). Triggers associated with this 
triggering event are evaluated upon every dialog iteration; 

• Dialog start - Occurs when the first request to begin a dialog is received by 
the dialog engine from the user's browser or client software. Triggers 
associated with the dialog start event typically create the initial set of goals 
to be resolved in the course of the dialog and set up any initial constraints 
based on the properties of the user (such as their entitlement level); 

• Dialog finish/quiescence - Occurs when all current dialog goals have been 
resolved. Triggers associated with the dialog finish event are often used to 
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create new goals based on the resolutions of the current goals. This 
essentially causes a "sequencing" of the dialog in which, for instance, goals 
A, B, and C are resolved first; and their completion causes creation of goals 
E and F next, etc. Since quiescence can occur multiple times within a 
complete dialog, dialog finish/quiescence triggers are often evaluated more 
than once during a dialog; 

• Create a goal - Adds a new dialog goal to the current dialog's set of goals 
to be resolved. The create goal action can indicate any of the parameters 
that specify a dialog goal and how it is to be resolved. These include: 

- the taxonomy associated with the goal; 

- the starting concept-node point in that taxonomy; 

- what type(s) of constraints or preferences the goal creates; 

- the set of target nodes for the goal; 

- whether the goal can be resolved by using a known preference or 
concept-node tag within the user's profile information, if an appropriate 
one is known; 

- whether the goal can be resolved by using a concept-node tag derived 
automatically from the text of any question the user typed in as part of 
this dialog, if one is available; 

- if resolving the goal requires asking the user follow-up questions, 
what type(s) and format(s) of follow-up questions the dialog engine 
should generate and return to the user (possible types of follow-up 
questions are described below); 

- whether the goal is resolved when any one of the subgoals is resolved, 
all of the subgoals are resolved, or some fraction of the subgoals are 
resolved 

similarly, whether users are allowed to give only a single answer to 
follow-up questions generated from this goal, or can select multiple 
answers. 

• Retract a goal - Removes a dialog goal from the current dialog's set of 
goals to be resolved; 
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• Goal resolution - Occurs when a particular goal is resolved. In some 
embodiments, goals may be given symbolic names when they are created 
so that triggers may be easily associated with the goal resolution event for 
the goal. As described above, trigger conditions may test specifics of how 
the goal was resolved. 

• Allow action/event - As described above, a trigger action can cause the 
option of executing an action to be displayed to the user. If the user selects 
the option, this can either cause a specified action to be executed (as 
described above), or it can cause a triggering event. This allows a dialog 
designer to associate one or more triggers with the event of the user 
selecting the action. This is powerful because it gives the dialog designer 
the ability to create any number of "named" groups of triggers that can be 
evaluated when the user selects an allow-action indicator. 

• Create/remove a constraint - Adds a new, specified constraint to the set of 
constraints applicable to the current dialog; or removes an existing 
constraint. Constraints limit the set of documents and concept-nodes that 
will be considered for return to the user in subsequent dialog responses 
generated by the dialog engine. Thus, triggers associated with this event 
can be thought of as "attached" to the particular concept node. As 
described above, concept-nodes can be accepted within initial inputs to the 
dialog, by a user's selection during the dialog, and by actions of triggers; 

• Declare a taxonomy as irrelevant - Causes the specified taxonomy to be 
treated as "irrelevant" by the dialog engine for the remainder of this dialog. 
That is, the taxonomy and concepts within it will not be used to rank or 
constrain the set of documents being returned to the user; and any not-yet- 
resolved goals associated with a taxonomy will be resolved as irrelevant. 
Constraints based on nodes in the irrelevant taxonomy are removed from 
the dialog engine's state; 

• Declare a taxonomy as relevant - Similar to above, causes the specified 
taxonomy to be treated as "relevant" by the dialog engine. That is, the 
taxonomy and concepts within it may be used to rank or constrain the set of 
documents being returned to the user; 
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• Escalate - Causes information about the current state of the dialog to be 
formatted and forwarded to either a human expert or another automated 
system for further processing. This action may or may not end the current 
dialog. In some embodiments, a variety of modes of interaction with an 
expert may be initiated by the action depending on the action's parameters. 
For example, escalate can cause a "live chat" type of interaction with a 
human to appear within the user's web browser or other software client 
being used to interact with the dialog engine. The escalate action can cause 
some or all of the dialog state information to be forwarded to the human 
service representative at the other end of the live chat, thus allowing them 
to provide higher-quality service by knowing what questions, follow-up, 
documents, etc., the user has viewed and chosen during the dialog 
interaction so far. Other alternatives include: escalation to a call center in 
which a human customer service representative will call the user; to a call 
center in which the user may call a service phone number, but then will talk 
to a customer service representative who has the information available 
about the dialog the user had with the dialog engine before escalation 
occurred; a "voice-over-internet protocol" interaction, in which a human 
customer service representative can have a voice conversation with the user 
through the user's computer, that is transmitted using the network that 
connects the user's computer with the service representative's work station. 

In some embodiments, an appropriate human service representative, 
group of human service representatives, and/or automated response system, 
may be chosen automatically by dialog engine 232 based on the 
characteristics of the user (e.g. their interests, their entitlements, their 
business relationship with the company providing the dialog engine) and/or 
of the dialog state (e.g., the product, symptom, or issue being discussed in 
the dialog). In other embodiments, the appropriate human service 
representative, group of human service representatives, and/or automated 
response system, may be simply indicated as a parameter of the escalate 
action that is recorded by the dialog designers within a trigger. In still 
other embodiments, the appropriate human service representative, group of 
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human service representatives, and/or automated response system, may be 
selected by a system external to the dialog engine based on the 
characteristics of the user and/or of the dialog state; 

• Allow action/event - Creates a "button" or other indicator within the output 
of the current (and possibly subsequent) dialog steps, such that when the 
button or indicator is then selected by the user, the specified action or event 
will be executed by the dialog engine. In general the action can be any 
action that can appear in the action list of a trigger, including actions added 
to the dialog engine to extend it, as described below. For example, a 
trigger may "allow action(escalate)", causing the user to be presented with 
the option of escalating to a human service representative on subsequent 
screens. If and when the user selects this action, the escalate action 
described above is executed by the dialog engine. Alternatively, allow- 
action can be given parameters that will cause the selection of the allow- 
action to cause the user's browser or other client software to initiate a 
request to some other system outside of the dialog. For example, a trigger 
may "allow action(shopping cart)" causing the user to be presented with 
the option of adding some product to their "shopping cart" of items to 
purchase on subsequent screens; 

• Add document to output/banner - Adds an indicator of a document (e.g., its 
title and possibly other summary information, hyper-linked to a screen that 
presents the whole document) to the dialog engine's response to the user. 
In some embodiments this indicator can be added to the dialog engine's 
response in a specific part of the response that we will refer to as the 
"banner". This action, combined with the one below, allows dialog 
designers to write triggers that (among other things) can be used to produce 
an intelligent "cross-selling" capability, in which users are presented with 
documents, banner "advertisements", or other information, at appropriate 
points in their dialog with the dialog engine. These points are identified by 
the trigger conditions and triggering actions in the triggers that add things 
to the banner area; 
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• Add other content (e.g. XML) to output/banner - Like the action above, 
this action adds any content the dialog designer wishes to the dialog 
engine's response to the user. In some embodiments this indicator can be 
added to the dialog engine's response in a specific part of the response that 
we will refer to as the "banner". In one embodiment, as described above, 
the dialog engine's responses are cast in a standard syntax such as XML; in 
these embodiments this action may simply add specified XML into the 
response; and 

• Add document or other content to user's "home page" - In some 
embodiments, the dialog engine keeps track of a "home page" of 
information for each user. This "home page" can include documents, 
questions with known answers, PQ's (as described below), concept-nodes, 
dialog responses, and other information, that is thought to be relevant to the 
user. This trigger action adds a link to a document or other content of the 
kinds just listed to the current user's home page. When combined with the 
"allow action" action described above, for example, this action could be 
used to give users the option of "bookmarking" documents or other dialog- 
related information on their home page, for later use, by selecting an allow- 
action indicator that initiates this action. 

• Accept a concept-node - Occurs when a particular concept-node is 
accepted during the course of the dialog. This event adds the concept-node 
to the set of known confirmed accepted concept-nodes. The concept-node 
can subsequently cause goals to be positively resolved or advanced; and 
can subsequently cause the dialog engine to prefer documents that are 
tagged to the concept-node. Because confirming a concept-node may be a 
triggering event (as described below) accepting a concept-node in the 
action of a trigger causes the triggers associated with the accepted concept- 
node to be evaluated. Thus, triggers associated with this event can be 
thought of as "attached" to the particular concept node. As described 
above, concept-nodes can be accepted within initial inputs to the dialog, by 
a user's selection during the dialog, and by actions of triggers; 
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• Reject a concept-node - Adds the concept-node to the set of known 
confirmed rejected concept-nodes. The concept-node is no longer 
available. This can subsequently cause goals to be negatively resolved; and 
can subsequently cause the dialog engine to reject documents that are 
tagged to the concept-node. Rejecting a concept-node is not a triggering 
event; and 

• Dialog preference creation - Occurs when a particular concept-node is 
indicated as a preference during the course of the dialog. Thus, triggers 
associated with this event can be thought of as "attached" to the particular 
concept node. As described above, preferences can be created as a side- 
effect of a user's selection during the dialog, and by actions of triggers. 

The last two triggering event types described - concept-node confirmation and 
dialog preference creation events - can be thought of as ways that triggers are 
"attached" to particular concept-nodes. Since concept-nodes exist within a taxonomic 
structure, in some embodiments it is desirable to allow triggers to "inherit" up the 
taxonomic tree or DAG. This section describes a trigger inheritance mechanism. 

To understand why this may be useful, consider a diagnostic dialog case where 
one taxonomy's concepts indicate symptoms a user is experiencing, and a 2 nd 
taxonomy indicates product vendors. One concept-node within the symptoms 
taxonomy is "printing problems", and it has a number of children and grandchildren 
that indicate more specific kinds of printing problems. Within this environment, a 
dialog designer wishes to create a goal in the product-vendor taxonomy, starting at the 
"printer vendors" concept-node, whenever any kind of printing problem is confirmed. 

Without trigger inheritance, the dialog designer could associate the trigger that 
creates the "printer vendors" goal with the concept-node-confirmation event of the 
"printing problems" node, and every descendant concept-node below "printing 
problems," but it would be very inconvenient. 

With a trigger inheritance mechanism, the dialog designer would associate the 
trigger that creates the "printer vendors" goal only with the concept-node-confirmation 
event of the "printing problems" node. Whenever a concept-node below "printing 
problems" is confirmed, the trigger inheritance mechanism evaluates not only the 
triggers associated with that concept-node's confirmation event, but the triggers 
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associated with confirmation events of each of the concept-nodes above that concept 
node - including the "printing problems" node. 

Stated more generally: the trigger-inheritance mechanism applies to events that 
are per-concept-node, such as the concept-node confirmation and dialog preference 
creation events. Whenever one of these events occurs, the triggers at the concept-node 
for which the event occurred are evaluated first; then, the triggers associated with the 
same event at the concept-node's parent(s) are evacuated; then, the concept-node's 
grandparent(s); and so on, until the top of the taxonomy (a concept-node with no 
parents) is reached. In some embodiments, trigger-inheritance may be limited to a 
specified number of steps up the taxonomy. 

In some embodiments, it may be desirable to add to this simple mechanism a 
further way of controlling to which triggers inheritance does and does not apply, so 
that the dialog designer can "override" inheritance when so desired. 

Consider the "printing problems" example. Perhaps there is a particular kind 
of printing problem (indicated by, say, a grandchild concept-node of the "printing 
problems" node) for which the "printer vendor" is in fact irrelevant, and instead (say) 
the vendor who manufactured the cable connecting the printer to the user's computer 
is important. In such a case, the dialog designer would like all of the other nodes 
under "printing problems" to inherit the trigger that creates the "printer vendor" goal; 
but would like to "override" that inheritance for the "printer cable problem" concept- 
node, and instead, in that concept-node, use a trigger that creates a goal to resolve the 
"printer cable vendor". 

One scheme that can be used to support this type of inheritance overriding uses 
optional labels on triggers to indicate to the dialog engine when to evaluate an 
inherited trigger and when not to do so. In this scheme, only one trigger with a given 
label will be evaluated in response to a particular triggering event. 

In the printing example, the dialog designer would simply place a label (such 
as "print_vendor_trigger:") on both the trigger associated with the "printing problems" 
concept-node and the trigger associated with the "printer cable problem" concept- 
node. When "printer cable problem" becomes confirmed, the dialog engine will 
evaluate the trigger associated with the "printer cable problem" concept-node, but will 
then not evaluate the trigger with the same label in the "printing problems" concept- 
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node - thus effectively overriding it. When other concept-nodes descended from 
"printing problems" are confirmed, the trigger associated with "printing problems" 
will be evaluated just as before. 

In some embodiments these trigger actions can be aggregated into named 
functions, which may be called with input and output parameters, from other actions, 
thus forming a type of programming language. Indeed, the whole trigger could be 
expressed as an "if statement in a programming language. In other embodiments 
there may exist a way to extend the set of predicates (possible conditions) and the set 
of actions by incrementally adding new predicates or actions implemented using any 
external programming language, such as Java, C++, C, Basic, Perl, or Fortran. This 
could be used, for example, to allow a trigger to test a condition associated with a user 
of the dialog engine that is actually stored or derived from a database or system that is 
external to the dialog engine, such as an external database of customer information, 
security and entitlement information, etc. 

There are several types of triggers, the most common being a concept trigger. 
A concept trigger is associated with a set of concept nodes in a knowledge map and is 
activated when the dialog advances to those nodes. That is, when a node is confirmed, 
all the triggers associated with that node are evaluated, and if their conditions permit, 
the triggers are executed. In this and other instances where an event depends on 
reaching a set of nodes, the dialog designer can specify whether the event takes place 
when one member of the set is reached, all members are reached, or a proportion of 
the set is reached. The notion of a concept trigger is further explained with reference 
to FIG. 10. There are two taxonomies shown in FIG. 10, a meal type taxonomy T10 
and a menu type taxonomy T20. When a user states that they want breakfast, node 
T30 becomes confirmed. When that occurs, trigger T40 is executed. Trigger T40 
causes the system to open the menu to the section entitled "Breakfast". As explained 
further below, a trigger's actions can cause new dialog goals to be created (thus 
causing follow-up questions to be generated); can add constraints to the taxonomy 
areas under consideration; and can cause escalations to occur. 

Information about the user and the dialog interaction is continuously captured 
in a dialog state which is stored and passed along with each user request/response. 
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The dialog state maintained by the dialog engine includes but is not limited to the 
following: 

- focus nodes; 

- target nodes; 

- constraints; 

- background preferences; 

- dialog preferences; 

- confirmed nodes, both accepted and rejected; 

- goals, both active and resolved; 

- root nodes of goals; 

- nodes returned by autocontextualization; 

- text returned by the interface module, including query text submitted during 
any iteration by the user; 

- taxonomies to which autocontextualization is applied; 

- taxonomies from which documents are retrieved; 

- taxonomies within which dialog navigation occurs; 

- the history of the interaction (inputs, events, actions, and outputs of previous 
iterations); and 

the user's ID. 

Each of these elements will be more fully explained below. 
A. FOCUS NODES/TARGET NODES 

Each goal is comprised of one or more "target" concept nodes paired with one 
or more focus nodes. The concept nodes represent the node or nodes within the 
taxonomy at which the dialog will ultimately terminate, while the focus node 
represents the starting location in the taxonomy. The focus node of the goal captures 
the current status of the goal resolution process. The focus node is the most detailed 
information available to the dialog engine at each point in the dialog. Each question 
posed to a user is generated from the focus node of the goal, while the answer 
selections offered to the user are the focus node's children. In some embodiments, 
each user question results in a single set of focus nodes and a single set of target 
nodes. In other embodiments, there may be multiple sets of focus nodes and target 
nodes, such that each set of focus nodes is paired with a set of target nodes. 
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B. CONSTRAINTS 

The set of concept nodes relevant to the user's information need is denoted 
using constraints. Constraints play a dual role in a dialog: they constrain the concept 
space to limit or guide the interaction, and they restrict documents returned to the 
relevant areas. All concept nodes that have not been explicitly ruled out with 
constraints are termed available. Thus in the beginning of the dialog all concept nodes 
in the knowledge map are typically available. As a dialog goes through successive 
iterations, the set of available concept nodes shrinks. Each node accepted during 
resolution of the goal produces a <predicate> <node> expression that thereafter 
constrains the available nodes. The list of accepted nodes in each subgoal is used to 
generate positive constraints while the rejected nodes are used to generate negative 
constraints. Negative constraints control the effect of negative information gathered 
(rejected concept nodes) on the relevant concept space. In addition, a default negative 
constraint may be used if the dialog designer does not specify one. As in the case of 
positive constraints, negative constraints stemming from the same subgoal are joined 
together by a Boolean operator. In some embodiments only a subset of the negative 
constraint types are allowed. In one embodiment, NOT-AT is the default negative 
constraint type. In this embodiment, all the rejected concept from each subgoal 
generate a constraint NOT-AT <node>. Both positive and negative constraints are 
unified for the final expression from a subgoal, and constraint expressions from 
different subgoals within a goal are joined together. 

The set of available nodes influences: 

- the set of documents that are deemed by the system as relevant to the user 
query; 

- regions of taxonomies from which focus nodes and target nodes may be 
drawn; 

- the target concept set of a goal; 

- possible solutions (PQs) proposed to the user; and 

- other actions that may be triggered. 

Constraints are expressed as constrained Boolean expressions consisting of 
taxonomic predicates that define sets of nodes by„taxonomic relationships. For 
example, if a goal constraint type is UNDER and concepts a and b are accepted in a 
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subgoal, UNDER a and UNDER b constraint expressions will be generated. All 
constraint expressions from a single subgoal are aggregated into a Boolean formula. 
The dialog designer can specify the operator to be used at the goal level. In the 
implemented embodiment, the default operator is conjunction. In our previous 
example, the final expression generated from the subgoal will be (UNDER a) AND 
(UNDER b). If the goal contains more than one subgoal, the subgoal constraint 
expressions are assumed to be a part of a Boolean expression. The dialog designer can 
specify what operator to use for a given goal. In an embodiment in which the most 
common interpretation of multiple user selections is uncertainty, the default operator is 
disjunction. So, if in addition to the subgoal in the previous example, there was 
another subgoal with accepted node c, the goal would produce the following 
constraint: ( (UNDER a) AND (UNDER b) ) OR (UNDER c). 

In addition to taxonomic constraints, the present invention also utilizes meta- 
data constraints that limit the remaining document set based on meta-data associated 
with documents. A meta-data constraint could for example, limit the document set to 
documents written by a particular author or list of authors; documents created or 
modified during a particular range of dates; documents whose titles match a given 
textual pattern; documents that were originally drawn from a particular document 
source, etc. Taxonomic and meta-data constraints can be embedded in a Boolean 
expression to create an overall constraint. 

C. BACKGROUND PREFERENCES/DIALOG PREFERENCES 

Preferences are used in ranking to influence the order of presentation of 
documents. Background preferences allow the system to keep basic information about 
each user (e.g., their interests, computer hardware, software, etc.), and dialog 
preferences describe concepts that are of interest to the user in the context of the 
current information request. Background preferences and dialog preferences may 
affect ranking by different amounts. That is, in one embodiment, dialog preferences 
have a greater affect on ranking than background preferences, and in a second 
embodiment, background preferences have a greater effect on ranking than dialog 
preferences. The relative effect of one kind of preference over the other is a system 
parameter that may be changed from installation ^installation. 
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The combination of taxonomies, taxonomy tags, taxonomic restrictions 
(filters), and knowledge containers provide a large collection of personalization 
capabilities to the present system. Certain of these taxonomies can be used to: capture 
the universe of information needs and interests of end-users; tag the knowledge 
containers representing these users with the appropriate concept nodes from these 
taxonomies, and use these concept nodes when retrieving information to personalize 
the delivery of knowledge containers to the user. Further, the system can use this 
tagging and other aspects of the knowledge containers in order to create a display 
format appropriate for the needs of the user receiving the knowledge container. 

In order to personalize interactions with a specific customer, the system utilizes 
an application screen associated with browser 132 for representing customers, their 
interests and needs. The application screen is a user interface that poses questions to 
the user and based on the user's response returns nodes back to dialog engine 232 to 
begin the next iteration. The application screen can be programmed to automatically 
give dialog engine 232 any information the user could otherwise provide. For 
example, dialog engine 232 could ask whether the user is a novice or expert. An 
application screen designed for novices could provide this information without 
actually posing the question to the user. The system supports profiling a customer's 
interaction with the system explicitly based on stated or applied preferences, and 
implicitly based on what the system has learned from interacting with the customer. 

Explicit profiling allows the user to select items of interest explicitly from one 
or more taxonomies. These, along with a default or explicit weight, become inputs to 
the application screen. Implicit profiling, on the other hand, relies on the system to 
add or modify the application screen in order to profile the customer. For example, 
when creating the application screen, the system may set a concept in "access level" or 
"entidement level" taxonomies that match the privileges they wish to accord the end 
user whom the application screen represents. 

The system may alternatively observe user behavior and then modify the 
application screen accordingly. That is, the system can increase the weight of a 
taxonomy tag frequently spotted in the user's questions during the 
autocontextualization segment of the retrieval process. Finally, the business context of 
the interaction, including the application screen, can create an implicit profiling which 
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drives the retrieval. For example, a particular web page or email address from which, 
or to which a question is entered into the system may implicitly add taxonomy tags to 
the user's question. This particular kind of implicit profiling is typically transient in 
that it only modifies the current interaction, but does not change the data in the 
application screen. 

In one embodiment of the present invention, the system is capable of using 
customer profile information described above to push content to interested users. 
More specifically, when new knowledge containers 20 enter the system, the system 
matches each against each customer's profile (taxonomy tags 40 in the associated the 
application screen. Knowledge containers 20 that match customer profiles sufficiently 
closely — with a score over a predetermined threshold — are pushed to customers on 
their personal web pages, through email, or via email to other channels. 

The type of preferences generated from a goal is controlled by the dialog 
designer. Similarly to constraints, positive preferences are generated from the 
accepted nodes, and negative preferences from rejected nodes. An arbitrary predicate 
can apply to preferences to define the set of nodes as desirable or undesirable. Unlike 
constraints, all preferences are added to a common pool, with no Boolean logic 
associated with them. This follows from their use in ranking rather than as set 
operators. 

Constraint and preference types are set per goal so that accepted and rejected 
nodes of different goals (from different taxonomies) can have different effects on a 
particular dialog. For example, consider a Vendor's and SymptomObserved 
taxonomy. If a user indicated that the symptom they observed was "garbage text 
printed" and they have an HP printer, the user would not be interested in seeing any 
document about printing problems other than garbage text being printed. At the same 
time, if the problem can be general to any printer, they would want to see documents 
that describe resolutions non-specific to HP printers. Therefore, different constraints 
should be generated from the two goals. 
D. CONFIRMED NODES 

From the point of view of dialog engine 232, a dialog with a user involves the 
process of arriving at the set of nodes that best jdescribes the user's information need. 
Confirmed nodes are those nodes whose relevance to the user's information need has 
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been established. They capture information that is known about the user's information 
need at each point in the interaction. Confirmed nodes are established based on: user 
selections on the screen; relationships in the domain encoded via triggers; automatic 
confirmation of topic spotter nodes; automatic confirmation of user preferences; and 
the front end graphical user interface (GUI). Discovering the best set of concept nodes 
will cause the presentation to the user of that set of knowledge containers that is most 
likely to contain a problem resolution. Three distinct states of confirmed nodes are 
recognized: 

- a node known not to be relevant to the user's information need, is referred to 
as irrelevant or rejected. One instance of such a set is an irrelevant taxonomy; 

- a node that may or may not be relevant is marginal; 

- a node that is known to be relevant is termed accepted and we refer to the set 
of accepted nodes. 

E. GOALS 

A goal in the context of the present invention indicates the information 
requirements for the next step in the interaction and the guidelines for eliciting the 
information from the user. Creating a goal in a taxonomy: (1) signals that the domain 
of the given taxonomy is relevant to the interaction; (2) it identifies the information 
needed; (3) provides guidance on how best to elicit needed information from the user; 
and (4) establishes how to deal with uncertainty arising in the process of information 
gathering. This builds on a basic observation that in a dialog, specific information 
becomes relevant only in certain circumstances. For example, in a dialog for 
troubleshooting printers, the type of network between the computer and printer is only 
relevant once it is established that there is a problem in communication between the 
two devices. An important innovation of the mechanism is that it allows the dialog 
engine to pose a question only once it has become relevant (but without requiring a 
complete case-based analysis). 

In one embodiment of the system only one goal can be created in a taxonomy. 
In another embodiment, multiple goals can be created in a taxonomy, where each goal 
represents a target set of concepts in a context. For example, the HW Vendor 

Taxonomy 330. (FIG. 6) may be needed multiple times - to establish the vendor of the 

printer, the printer driver, and software that is used for printing. In this example, the 
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context for each goal in the taxonomy will be the device whose vendor the system is 
trying to identify. Thus, the context of a goal can be represented by the concept node 
whose trigger created the goal or as the taxonomy in which the concept node is 
located. 

Once dialog engine 232 creates an initial set of goals (target nodes and focus 
nodes) based on the subject matter of the user's inquiry, it begins to resolve the goals. 
The process of goal resolution is one of taxonomy traversal, going from more general 
concepts at the root to more specific concepts closer to the leaves of the taxonomy 
graph. Advancing a dialog from one node to the next advances the focus of the goal, it 
causes the triggers associated with each node to be evaluated and it causes constraints 
to be generated. A goal is considered resolved when a target set of concept nodes is 
reached during a traversal. When dialog engine 232 receives an answer from a user, it 
identifies one or more goals for the dialog, based on the dialog engine's current 
understanding of the user's response. Dialog engine 232 improves its understanding 
of the user's initial question by conducting a multi-step dialog with the user. Based on 
the user's responses to follow-up questions, the dialog engine is further able to focus 
its analysis of the user's response (i.e., limit the remaining sets of concepts by creating 
constraints). In other words, dialog engine 232 seeks to describe the user's 
information request in more and more detail by mapping user responses to concept 
nodes in the goal taxonomy. FIG. 1 1 further illustrates the goal resolution process in 
accordance with an embodiment of the present invention. As shown in FIG. 1 1, the 
subsequent selection of a new concept node by dialog engine 232 proceeds as the user 
answers questions posed by the dialog engine. As shown at U10, when the user 
answers "eggs" in response to the question "Which of the following would you like to 
get," the goal of the dialog proceeds from the "Breakfast" node to the "eggs" node. 
Similarly, in U20 when the user answers "scrambled" in response to the question 
"How would you like your eggs prepared," the goal of the dialog proceeds from the 
"eggs" node to the "scrambled" node (U30). In this example, the nodes selected are 
confirmed nodes since they represent nodes whose relevance to the user's information 
need has been established. 
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In an embodiment where each goal is tied to a particular taxonomy, the target 
set of concept nodes is a function of that taxonomy. The target set can also be defined 
in any of the following ways: 

- all leaf nodes in the target taxonomy; 

- any node or set of nodes in the target taxonomy designated explicitly by the 
dialog designer; 

- any node in the target taxonomy that is at or below level K in the tree; 

- any node in the target taxonomy that is K or fewer levels below a subgoal 
focus node; 

- any set of nodes in the target taxonomy that can be defined by any taxonomic 
distance function from a node specified by the dialog designer; and 

- any set of nodes in the target taxonomy that can be defined by a non- 
taxonomic-distance function from either the root node of the goal or from a 
node specified by the dialog designer, such as document overlap among the 
nodes, or similarity of vocabulary of documents at the nodes. 

A goal may be resolved positively or negatively. A goal is resolved positively 
when one, some, or all (depending on what the dialog designer specified) of its target 
concept nodes are confirmed as accepted. A goal is resolved negatively when all of its 
target nodes are confirmed as rejected or constrained to be unavailable, or when its 
taxonomy is declared irrelevant. In the process of goal resolution the system traverses 
the taxonomy graph, typically going from more general to more specific concepts. 
The process of choosing one path over another is sometimes difficult, particularly if 
there is uncertainty as to which branch applies or when multiple branches are relevant. 
It is a good practice during taxonomy building to avoid branches that are likely to be 
difficult to choose between, but it is not possible to avoid the issue entirely. If such a 
situation occurs, and the user chooses multiple nodes at a branching point, the dialog 
engine will create multiple subgoals for a goal. Subgoals of a goal are a mechanism to 
deal with uncertainty or multiplicity of the interaction. Resolution of each subgoal 
will be pursued in parallel by the dialog engine until the conditions are reached that 
resolve the parent goal of the subgoals. In fact, the system uses properties of subgoals 
in the process of goal resolution, so one subgoal is always created. Subgoals are 
identified by the node that represents the most detailed information. This node is 
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referred to as focus of a subgoal. In the process of goal resolution, the focus is 
typically advanced along the edges of the taxonomy graph, but may jump to a node (or 
set of nodes) more than one edge away from the previous focus. Subgoals are 
resolved when their focus reaches the target set of concept nodes. Note that the 
constraints generated in the course of a dialog can limit the node set available beyond 
the initial set specified in the goal, and occasionally all the choices will be ruled out 
rendering a subgoal unresolvable by normal means. In this case, a subgoal is 
designated to be constrained away and is treated as resolved. In the present invention, 
any combination of subgoal resolutions may be sufficient to resolve the subgoal. For 
example, reaching any node in the target set of any subgoal may be sufficient. 
However, if the user made multiple selections and several subgoals were generated, 
resolving one may not be enough to completely establish all the nodes relevant to the 
user's information request in the given taxonomy. In one embodiment the dialog 
designer can choose to resolve a goal when: 

- any one of the subgoals is resolved; 

- all of the subgoals are resolved; and 

- some fraction of the subgoals is resolved. 

This provides maximum flexibility in interpreting multiple choices of the user. 

The subject invention also permits the user, dialog designer, or dialog engine 
to retire a subgoal or goal. The user may not wish or be unable to answer questions 
posed by a subgoal. In this case the invention provides a way to inform the system 
that they do not wish to see any more questions on the subject. The user may choose 
to ignore the questions posed, in which case the system will stop showing those 
questions. In one embodiment, the number of iterations a question is generated from a 
subgoal in the absence of a user response before the subgoal is retired is a parameter of 
the goal. In another embodiment, the parameter is a system-wide setting. At some 
point in a dialog new information may become available that will render a goal 
irrelevant. Dialog designer can trigger an action to retire a subgoal or a goal in this 
situation. 

This description discusses the process of goals and subgoals advancing 
interchangeably, with the understanding that advancing a goal implies advancing one 
or more of its subgoals. 
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Multiple goals can be active in the system at any point in the dialog, and the 
process of resolving goals may proceed serially or in parallel. A dialog in which 
questions are posed strictly sequentially may be constructed by asking a single 
question per goal. Such a dialog however, does not typically correspond to a natural, 
friendly, and efficient interaction. Posing questions in parallel, on the other hand, 
allows the user to answer relevant questions and simply ignore irrelevant questions. 
Until resolved, a goal is referred to as active. 

F. ROOT NODES 

Creating a goal signifies that the goal taxonomy is of relevance to the 
interaction. The root node of the goal serves as the starting position in the taxonomy 
for information elicitation - it is the focus node in the first dialog iteration that 
incorporates that goal. For example, assume a Vendor taxonomy exists in a 
knowledge map that represents various hardware and software vendors (see figure F). 
Further, suppose that during a dialog the system establishes that the user's problem 
relates to improper color printing by the printer. It may be important at this point to 
establish the vendor of the software the client is using, since color rendering may be 
handled differently by different programs. The situation warrants creation of a goal in 
the Vendor taxonomy that seeks to identify the software vendor. In an intelligent 
interaction, the question to be asked would be more specific than the one generated 
from the root of the Vendors taxonomy. To support such an interaction, when creating 
a goal for Vendor, the dialog designer should specify Software Vendor as the root 
node. 

G. NODES RETURNED BY AUTOCONTEXTUALIZATION 

The dialog engine can derive information from text that is typed in by the user. 
This process of deriving data is one of the many ways in which the dialog engine 
gathers information. All the text the user provides to the system is autocontextualized 
against the taxonomies in the knowledge map. This results in topic spotter nodes that 
represent the system's understanding of the user's input. Unlike confirmed nodes 
(discussed above), topic spotter nodes cannot automatically accepted as true since 
there ia always the possibility that dialog engine 232 misunderstood the user's input. 
Nodes returned by autocontextualization (topic spotter nodes) are verified by asking a 
follow-up question to confirm dialog engine's understanding of the user's input. 
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H. THE HISTORY OF THE INTERACTION (INPUTS, EVENTS, 
ACTIONS, AND OUTPUTS OF PREVIOUS ITERATIONS) 

In one embodiment, the history of the traversal in the process of resolution is 

stored in a subgoal as a list of accepted and rejected nodes. Keeping such history is an 

important feature of the dialog system, since it allows the end user to undo her 

previous answers if the need arises. The list of accepted and rejected nodes is also 

important for generating constraints and preferences based on user information that 

will help to better define the concept space relevant to the user query (and thus limit 

the document set retrieved and affect future dialog iterations). Finally, storing 

information about the path of the interaction up to the current point allows the dialog 

engine to base future decisions on the complete history of the interaction, not simply 

the current state. 

In operation, dialog engine 232 records the interactions between dialog engine 
232 and the user for future analysis. These logs may be stored either as structured log 
files, or as data within a relational or other type of database system. The logs can 
record any and/or all aspects of the dialog engine's interactions with users, including 
but not limited to: 

- User's names, associated concept-node tags and their strengths from the 
user's profile (which may include information about user's interests, user's 
business relationship with the company providing the dialog engine, user's 
entitlement level, user's experience level with the company's products or 
services, products the user owns or has shown interest in the past, etc.), and 
associated meta-data, for the user involved in each dialog; 

- For each iteration of each dialog, all of the possible inputs entered by the 
user, including textual input, responses to questions that involve selecting 
concept-nodes, responses to questions that involve entering text or other types 
of information, selection of actions, escalation, selection of documents for 
viewing, selection of packaged or parameterized question; selection of going 
"back" in the dialog to a previous point to start over or to re-select inputs for a 
particular iteration or follow-up question; 

- For each iteration of each dialog, the response returned by the dialog engine, 
including follow-up questions presented to the user, choices presented for each 
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follow-up question, documents presented, parameterized questions presented, 
etc; and 

- For each iteration of each dialog, any and all relevant information about the 
dialog engine's internal state and processing, which may include goals created, 
goals resolved and how they were resolved, concept-nodes identified 
automatically by text classification of a user's question or other similar means, 
triggers and other actions executed, the membership of the set of confirmed 
concept-nodes; the set of automatically-identified (text classified or "topic 
spotted") concept nodes; the set of dialog preference concept-nodes; the set of 
user's preference concept-nodes; constraints that are applicable to the dialog; 
etc. 

These logs provide an extremely rich source of feedback about usage of dialog 
engine 232, and the success of the knowledge map and dialog control information 
within the dialog engine in leading users to documents and other types of resolutions 
to their questions. 

The present invention further provides a logging capability in which: 

- Users may be logged not just with an ID but with all the concept-node tags 
and meta-data that represent what's known about the user. This allows 
analysis of the log broken down by users with particular properties; 

- Logging records each of the steps within a multiple-step dialog interaction 
with a user, as opposed to simply separate actions (clicks and queries). The 
dialog engine thus logs series of interactions in coherent groups that can be 
analyzed together. In addition, these series allow sequential analysis of user's 
actions. For example, the present invention can analyze not just how many 
times users took the action of, say, escalating their problem to a human 
customer service representative, but what dialog sequences and user properties 
most often lead to escalation; and 

- All logging is done in "semantic" terms - that is, concept-nodes within 
taxonomies. These taxonomies and concept-nodes represent dimensions and 
concepts that are relevant to the company providing the dialog engine's 
business. As opposed to normal world-wide-web logging, which simply 
provides undifferentiated "click" data, this concept-based logging allows 
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analysis of the interaction data based on concepts that are truly relevant, as 
opposed to "syntactic", surface information such as word frequency of words 
typed into a query box. 

Once the data has been collected, reports can easily be generated against the 
logged data that will provide answers to questions such as: 

Which types of users are easily finding answers to their questions concerning 
concepts in a particular taxonomy? (In a diagnostic environment, for example, 
this might be "Which types of users are easily finding answers to their 
questions about what products, and what symptoms they are having with those 
products?") 

Which types of users are not finding answers to their questions concerning 
concepts in a particular taxonomy? Of those, which are quitting (simply 
leaving the dialog engine interaction); which are escalating to human customer 
service representatives; which are starting over with new dialog interactions; 
which are examining large numbers of documents returned by the dialog 
engine to "by hand" find the one(s) that address their questions? 
Which areas or concept-nodes within taxonomies (or groups of such) have an 
appropriate amount of content/documents tagged against them such that it is 
proportional to the amount of user questions or issues being seen in those areas 
or concept-nodes, and conversely, which areas do not have enough content to 
support the volume and range of users' questions or issues? 
Which areas or concept-nodes within taxonomies (or groups of such) are 
experiencing high volume, or changing volume (spiking up or down over time) 
of user questions or issues? 

In some embodiments, the dialog engine or a separate piece of software may 
provide a way to visually examine taxonomy and concept-node based breakdowns of 
analyzed or aggregated logging data over all time, or over particular selected time 
periods. This visualization is performed by displaying the structure and concept-nodes 
of one or more taxonomies visually, and with each concept-node, providing a visual 
cue that indicates the value of the analyzed or aggregated logging data point being 
reported, for that concept-node. TTie v^suaLcue may be,, for example, displaying the 
concept-nodes in different colors (e.g. red may mean a low value, green a high value, 
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and the range of colors in between representing intermediate values); or by displaying 
a numeric value next to each concept-node; or by displaying one or more icons next to 
each concept node (e.g. a small, medium, or large stack of question-mark icons to 
represent query volume at each concept-node). This type of visualization can be very 
useful because it allows a dialog designer to get an overall view of the activity or 
aggregated/analyzed values across a whole taxonomy or set of taxonomies at once. 
The visual cues allow a person to very quickly identify the areas of taxonomies that 
may warrant further attention or analysis. 

In some embodiments, "reporting wizard" software may be available that can 
execute a large number of different useful logging data analyses, over all time or over 
specific timeframes of the dialog engine's use, and then use selection heuristics to 
select and present a dialog designer or other user with a listing of the most 
"interesting" set of reports, based on the selection heuristics. Typically, the selection 
heuristics would select reports that were very different from the norm of a family of 
similar reports, or that indicate areas where users are not effectively finding good 
resolutions to their questions or issues during their interaction with the dialog engine. 
For example, the selection heuristics may try to identify types of users and types of 
questions (both based on concept-node information, of course) in which users are 
asking large numbers of questions relative to the norm, but are also experiencing a 
large number of either start-overs or escalations relative to the norm. Similarly, the 
selection heuristics may try to select reports showing areas where there are "spikes" in 
user questions, or where the knowledge map is underpopulated with documents to 
address the volume of user questions. Similarly, the selection heuristics may try to 
select reports showing frequently asked questions (again, generally in terms of 
concept-nodes, and possibly user types) that take users multiple iterations to find 
documents. 

In some embodiments, "reporting wizard" software can go one step further, 
and based on its (generally heuristic) analysis of the interesting reports it has selected, 
can propose changes to the dialog designer or other maintainer of the knowledge map 
and dialog control information that may improve the experience of users of the dialog 
engine. For example, the reporting wizard software may analyze the report showing 
frequently asked questions that take users many iterations to find documents, and 
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propose the creation of a new "parameterized question" that could be presented in 
applicable situations in earlier dialog iterations, so that users can more quickly get to 
the documents that resolve these types of common issues. 

In some embodiments, the dialog engine can contain a module that performs 
various kinds of analysis of the logging data, in order to change the future behavior of 
the dialog engine and better customize dialog to a particular user based on prior usage. 
This feedback-based learning module may use a variety of statistical and machine- 
learning techniques to learn any of the following: 

- long-term user preferences for a particular user; 

- common dialog control information (triggers), including: 

relationships between concept nodes in different regions of the 
knowledge map (triggers confirming a node); 

relevance of taxonomies based on confirmed concepts (triggers creating 

goals or adding/removing taxonomies); and 

commonly targeted information (PQs). 
Long term user preferences, discussed above, can be learned not only by 
observing the selections a particular user makes during the dialogs she engages in, but 
also by comparing behavior of different users seeking the same information (as 
evidenced by common set of concepts confirmed, similar documents viewed, actions 
executed and/or PQs chosen). Learning dialog control information involves analyzing 
the progression of various dialogs to extract correlations between sets of confirmed 
nodes and other confirmed nodes. The tags of the documents viewed by the user are 
of particular interest since they represent areas of interest to the user. Learning control 
information involves discovering ways to guess earlier in the dialog what distinctions 
will be most useful for reaching a narrow answer set as quickly as possible. 

In one embodiment of the subject invention, it is envisioned that the system 
could log the data, apply known machine learning techniques, and feed analysis back 
into the system to provide a mechanism by which the system "learns" from prior user 
query patterns. In another embodiment, the feedback-based learning module learns a 
mapping from selected user profile data (including meta-data and concept-node tags) 
and confinned_or preferred concept-nodes to other preferred concept-nodes. In other 
words, this map indicates, for users with given properties, at a given point or points in 
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a dialog, what other concept-nodes may be considered as "preferred" by the dialog 
engine for its next response(s). This learning is based on a statistical analysis of 
previous usage that analyzes users' document selections. The concept-node tags of the 
documents, the users' properties, and the confirmed and preferred concept-nodes 
within the dialog iteration where the document was selected, plus the same 
information for iterations prior to the document's selection, are all inputs into the 
learning module that learns the mapping described. In yet another embodiment, the 
feedback-based learning module learns points at which triggers could be inserted. 
This learning is based on a statistical analysis of previous usage that analyzes users' 
traversal paths and success rates (as measured, for example, by selecting a document 
and subsequently exiting the dialog). Concept nodes A and B in distinct taxonomies 
that co-occur on many traversal paths of successful dialogs such that A occurs before 
B might be candidates for a trigger from A to B. In still another embodiment, the 
feedback-based learning module learns mapped PQs and the set of nodes that must be 
confirmed to trigger the display of the PQ. This learning is based on a statistical 
analysis of previous usage that analyzes confirmed nodes, document selections, and 
success rates, and looks for occurrence of a set of confirmed nodes and a particular 
document selection in many successful dialogs. 

- Any and all of the following information sources may be used by the learning 

module: 

confirmed (accepted and rejected) concepts; 
. questions user chose to ignore in the course of a dialog; 
questions user explicidy declined to answer; 
documents viewed in the course of a dialog; 
PQs selected in the course of a dialog; 
actions executed in the course of a dialog; 
tags of the documents/PQs viewed; 

information about the length of time the user spent on particular 

documents viewed; and 

final outcome of the dialog interaction. 

Now that the major elements of the present invention have been introduced, the 

specification will now describe the process performed by dialog engine 232 as it 
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resolves a user request for information. Each separate cycle of system question and 
user answer is referred to as a dialog iteration. During a typical dialog, dialog engine 
232 will support multiple iterations. In each iteration, dialog engine 232 analyses user 
inputs up to that point in the dialog and presents the user with new questions, 
documents and actions (e.g., contact a customer service representative). That is, the 
dialog engine inputs concept nodes (among other things), updates its state with new 
constraints (limit the available concept nodes) and preferences (modify the ranking of 
nodes and documents), and outputs resolutions and new questions to the user. The 
user can choose to accept one of the resolutions or continue the dialog by answering 
more questions. In essence, the user's answers create additional constraints and 
preferences that further limit and rank the space of available concept nodes in a 
knowledge map. Discovering the best set of concept nodes will cause the presentation 
to the user of that set of knowledge containers that is most likely to contain a problem 
resolution. 

In one embodiment of the present invention, a multi-step dialog begins with 
the user of the system entering via either boxes where they can type text, or selection 
lists of possible choices, a combination of: 

a) query text (possibly added to the query text from a previous step), 

b) desired administrative meta-data values; e.g. desired date ranges for 
creation-date of knowledge containers to be retrieved, 

c) taxonomy tags and weights (perhaps segmented for ease of entry; e.g. 
"Very relevant", "Somewhat relevant", "Not relevant") to be associated with 
the question; 

d) taxonomic restrictions, used as described above (with respect to retrieval 
techniques) to limit the areas of taxonomies from which response knowledge 
containers are drawn; and 

e) User preferences. 

All the sources of information available to the system are used in the process of 
advancing a subgoal. The advancing mechanism can make use of 
autocontextualization information, user preferences, confirmed nodes (e.g. information 
already verified in the course of interaction up to this point), nodes„explicitly specified _ 
by the dialog designer, or any other information source available. Since it is assumed 
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the underlying information need of the user does not change in the course of a single 
dialog, the dialog engine can always use confirmed nodes to advance goals. However 
sometimes other information can not be fully trusted. In particular, 
autocontextualization, being an automatic process, can make mistakes. Therefore it 
may not be safe to assume that correct concept tags have been extracted from the 
query. User preference information, though human-entered, may be outdated. For 
example, it may state in user's profile that they own a black-and-white HP LaserJet 
printer. However in the course of the interaction their problem was established to be 
that of color printing. Clearly, previous printer information is no longer relevant. 
Thus, whether or not subgoal focus is advanced to a concept because it appears in user 
preferences, autocontextualized nodes, or other source of node information is 
governed by a goal parameter whose value is set by the dialog designer. This 
approach provides maximum flexibility by allowing the use of precisely as much 
information as appropriate in each situation. In addition, another goal parameter 
governs whether or not the user is asked to verify the conclusions inferred by the 
system. 

One additional source of information in the system are newly created goals. It 
may happen that a goal is created in a taxonomy where another goal already exists. If 
the goals are created in the same context, the new one can contain additional 
information that was not available at the first time the goal was created. For example, 
if a goal was created in the Diet taxonomy (FIG. 12) rooted at the top level in the 
Vegetarian node, and later on a new goal rooted at Menu is created, the system should 
take into account that the user wishes to order breakfast, not just any vegetarian meal, 
is relevant to the problem at hand. Thus, the focus of the subgoal in the Menu 
taxonomy is moved to Pancakes. The process of combining information contained in 
two goals in the same taxonomy is called goal unification. Goal unification considers 
the root nodes of the two goals in question and the focus(es) of the older goal. Three 
cases are possible: 

- a focus of the existing goal is below the root of the new goal - in this case the 
existing goal already contains more specific concept than the new one, so no 
new information is used; 
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- the root of the new goal is below a focus of the existing goal - in this case the 
new goal gives more specific concept node information, and the focus is 
advanced down to the root of the new goal; 

- the root of the new goal is not in the path of the root of the existing goal - in 
this case the new goal deals with a new region of taxonomy that has not yet been 
explored, and a new subgoal is created to explore that region. 

As mentioned above, dialog engine 232 generates follow-up questions to the 
user in the process of resolving active goals. The type of question to be generated can 
be specified by the dialog designer. The answers to these questions advance the state 
of the subgoal to a new location in the taxonomy - e.g. change the focus of the 
subgoal. Changing the focus of a subgoal may be by path traversal within the 
knowledge map (e.g., the focus may change from parent node to child node). 
Autocontextualization can be used to jump to a specific place in the taxonomy, and the 
dialog designer can explicitly specify a place to jump to. In any event, the node-to- 
node path taken by dialog engine 232 from the focus node(s) to the target node(s) 
heavily depends on user responses to system questions. For example, a selection 
algorithm may be applied to a focus node, F to produce a set of concept nodes, C 
which are associated with a question posed to the user (or to the application screen). If 
the user (or the screen) responds to this question, the response is mapped to one or 
more members, M of the set C. These members, M become the focus node, F in the 
set of focus nodes for the next dialog iteration. As described below, the target nodes 
may also change with each dialog iteration. 

The dialog engine 232 may then create a new entry screen for the user that 
represents the system's response in this step of the dialog and allows the user to enter 
their next query in the conversation via various entry areas on an application screen. 
This response can include one or more of: 

(1) Knowledge container results: a list of zero or more knowledge containers 
that the system considers possible "answers" or highly relevant information to 
the user's question. These can be presented as clickable links with meta-data 
indicating the knowledge container's title, synopsis, dates, author, etc., where 
clicking will lead the user to a screen presenting the full content of the 
knowledge container; alternatively, if the system has one or more knowledge 
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containers that it believes with high confidence will serve as answers to the 
user's question, it can simply display the full content of those knowledge 
containers directly. 

(2) Follow-up Questions: In order to advance the a particular dialog, follow- 
up questions are generated based on the current state of the dialog. As shown 
in FIG. 13, there are four categories of follow-up questions (clarifying 
questions, document questions, text questions, and parameterized questions). 
The invention analyses the dialog state at each iteration of a dialog and uses 
that information to determine what types of follow-up questions to generate 
and what choices to offer the user in each question instance. The dialog state 
may be viewed as having several different levels of specificity and the 
invention provides the dialog designer with the ability to generate different 
question types appropriate to those various levels. Depending on the 
characteristics of the taxonomy in which a goal is being resolved and position 
of a focus node within that taxonomy, the dialog designer may be provided 
with various means of defining which choices to offer to the user. By 
determining which choice options the user is presented with, the dialog 
designer controls the pace and direction of movement of the subgoal focus and 
the creation of new goals in other taxonomies. 

There are three levels of specificity that provide the dialog designer 
with a point at which to define follow-up questions: (1) the focus node level; 
(2) the active taxonomy level; and (3) the confirmed node state level. Each of 
these levels provides a different starting point for applying a selection 
algorithm (discussed below) to the surrounding taxonomic landscape for 
identifying a set of nodes. It is important to note that not all selection 
algorithms are appropriate for every level of specificity. Selection at the focus 
node level starts from a single node, the current subgoal focus node. This view 
could include the focus node's parent, siblings and immediate children. 
Depending on the selection algorithm's distance metric, the selection set will 
most likely be limited to nodes within the current goal's taxonomy. In 
contrast, the selection at the taxonomy level starts from the entire set of nodes 
in a taxonomy. Selection at the confirmed node state level starts from the 
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confirmed node set. At this level, the dialog designer 'sees' the state of the 
dialog as a set of nodes that the user has explicitly selected or has implicitly 
identified through the autocontextualization of user inputs. Various 
embodiments of the invention would define follow-up question types that are 
specific to each of these levels of specificity. Each of the levels of specificity 
allows the invention to apply a selection algorithm to a particular set of 
concept nodes which can be offered to the user. Many criteria could be used to 
determine the exact set of nodes available to be included in a selection set. 
Among these are: 

- Taxonomic nearness - Nodes are selected on the basis of traversal 
distance from the focus node with nearer nodes being preferred over 
more distant nodes. 

- Dialog designer selection - A means is provided for the dialog 
designer to select nodes for inclusion in or exclusion from selection 
sets. The latter represents a special case, in that the dialog designer 
should have the ability to designate certain concept nodes as being 
invisible for the purposes of generating a selection set. These invisible 
nodes serve as taxonomic structural elements but would be meaningless 
to the user as a selection in a selection set. Such a node has all the 
normal characteristics of a standard concept node except for visibility 
in selection sets. 

- Knowledge container (KC) tag overlap - The set of knowledge 
containers still available for selection provide a tag set that can be used 
to generate a selection set. In one embodiment, that set is analyzed for 
tag overlap, meaning those tags are preferred which occur in the 
greatest number of remaining KCs and/or have the highest cumulative 
tag weight. In another embodiment, when the remaining KC set is 
sufficiently small, the selection set is the entire set of nodes tagged to 
those documents. Other possible selection criteria include nodes with 
tags into the remaining KCs that are closest to a subgoal focus as 
measured by some distance metric or that set of concept nodes tagged 
into selected clusters of KCs. 
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- Vocabulary similarity - Those nodes are selected whose vocabulary 
(term set) is most similar to the focus node's vocabulary. 

- Previous display/confirmation status - In general, it is desirable to not 
redisplay selection choices that have previously been offered to the user 
or have been confirmed by user selection or some other means. 

In one embodiment of the invention, classes of follow-up questions will 
be implemented that embody various combinations of specificity levels and 
selection set choice criteria. As a general rule, a particular class of follow-up 
questions would be defined at one level of specificity and provide a single 
selection set defined by one or more criteria. In another embodiment, a class 
of follow-up questions would include multiple levels of specificity and present 
the user with multiple selection sets in a single instance of a follow-up 
question. 

In another embodiment, the dialog designer is provided with the ability 
to define a class of follow-up questions at the focus node level called 
Clarifying Questions (CQs). CQs represent the most basic follow-up question 
type, and would be the type seen most frequently by users. This would be the 
default question type generated from a goal if another question type is not 
requested by the dialog designer. These clarifying questions are constructed in 
a variety of ways: 

a) Taxonomy Selection: Users may be asked to indicate which of the 
returned taxonomies are relevant or irrelevant to the question at hand. 
For example, referring to FIG. 14, there is shown a typical user 
interface 1700 comprised of four "buttons" 1710-1740. When the user 
presses the Taxonomy Selection button (1710), the user is presented 
with taxonomies 1750-1770. The system may then ask the user if 
Geographic considerations (as an example) are an important aspect of 
the user's question, based on tagging the question via 
autocontextualization to a Geography taxonomy. The user's response 
to this type of question is added to the Taxonomic Restrictions of the 
user's question, resulting in the system discarding taxonomy 1770, 
which leads to a more precise response in the next round of the dialog; 
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b) Concept-Node Selection: Similar to region selection and 
adjustment, the application screen can allow users to select concept- 
nodes to add, remove, emphasize, or de-emphasize. The screen can 
display, for example, the concept-nodes returned by the system, along 
with possibly parent and child nodes, for selection. The user may 
choose to eliminate or add nodes from consideration. These can either 
be cast as restrictions - e.g. "My question has nothing to do with this 
concept", requirements - "My question is specifically about this 
concept (or its sub-concepts)", or preferences - "Emphasize or de- 
emphasize this concept". Restrictions and requirements are added to 
the taxonomic restrictions of the user's question for the next round of 
the dialog; preferences are added to the taxonomy tags passed in with 
the user's question for the next round of the dialog; 

c) Terminology Selection: The system may use the 
autocontextualization process to select a list of "related terminology" 
and present the list to the user, who may select one or more of the terms 
listed to be added to the question text. CQs are specific to the subgoal 
focus level. 

In one embodiment, a CQ is displayed as a text string and a list box offering a 
selection of concept nodes. The list of nodes presented to the user includes the 
taxonomic neighborhood of the subgoal focus minus any confirmed nodes and any 
nodes that have been previously offered as choices to the user. The dialog designer 
has the ability to define the text string for each node to be displayed as that node's 
designator in a CQ list box. If the value isn't defined, the node's description is used. 
Selecting a node from this list confirms that node and advances the subgoal focus to 
that node. It may also resolve the goal, depending on goal type and the taxonomic 
location of the selected node. The relative position of a subgoal focus within the 
dialog state provides one other criteria which can be used by the dialog designer in 
defining follow-up questions. The beginning and end of goal resolution are potentially 
unique cases because they may have abnormally large or small selection sets using the 
abovementioned possible criteria for set inclusion. 



57 



WO 01/67225 



PCT/US01/07056 



In the case where the selection set may be abnormally large, another follow-up 
question type, referred to as a Text Question (TQ), can be made available that allows 
the dialog designer to avoid displaying that selection set to the user. A TQ is intended 
for use in locations within a taxonomy where simply listing a node's neighboring 
nodes (as would be done with a CQ) would make for an overly long selection list or 
might require several iterations of a dialog to get information that might be obtained 
by a single answer from the user. Like a CQ, a TQ is specific to the subgoal focus 
level, but in the place of a selection set, the user is given a text box and is prompted to 
type in the desired selection. For example, if the dialog designer would like to 
ascertain what a customer would like to order in a restaurant, rather than list the huge 
selection of possibilities from the menu, the user can simple be prompted to type in 
their selection. The user's response is autocontextualized within the goal's taxonomy 
and all current constraints are applied. Any tagging outside the set of concept nodes of 
interest is ignored. Referring now to FIG. 15, it is illustrated that rather than 
presenting the user with a list of potentially hundreds of menu items, the user can type 
in his or her menu selection and thus answer the question in one iteration of a dialog. 
If the user's response autocontextualizes to a known menu item, that information 
points the dialog to the correct subgoal focus. Nodes identified by 
autocontextualization may become confirmed. If, however, the user's response is not 
recognized by the autocontextualizer, the TQ would be followed by a standard CQ 
listing all the possible next choices. Regardless of whether the user's typed entry 
autocontextualizes successfully, follow-up questions will be generated until the target 
set of concept nodes is reached. 

CQs are a simple means of advancing the focus of a subgoal towards 
resolution, advancing the focus one taxonomic level at a time towards a resolved state. 
In some cases, this doesn't give enough power or flexibility to the dialog designer. 
One such case is when the user has advanced a subgoal focus to its resolution and user 
wishes to continue the dialog. In one embodiment, the dialog designer will be 
provided with a follow-up question type that defines its selection set from the concept 
nodes tagged to the remaining document set (that is, nodes tagged to those documents 
that abideby constraints in the existing constraint set), optionally restricted to those 
concept nodes within the goal taxonomy. This type of follow-up question is known as 
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a Document-based Question (DQ). As shown in FIG. 16, a DQ presents the user with 
choices, based on the KCs remaining. 

In many cases, a site will contain a small set of knowledge containers that 
address a large percentage of the problems that bring users to that site. In one 
embodiment, the dialog designer will be able to define follow-up questions which 
allow the user to go directly to any relevant members of that set of particularly useful 
KCs. These are known as Parameterized Questions (PQs). PQs relate to the current 
state of the dialog as a whole, as defined by the set of confirmed nodes. At the end of 
each cycle of a dialog processing, the current set of confirmed nodes is used to select 
those PQs which best match the dialog state. Depending on the set of defined PQs and 
the state of the dialog, the set of matching PQs may well be empty. Referring to FIG. 
1 7, it is shown how a PQ can provide a shortcut to resolving a goal by presenting the 
user with a previously prepared or cached question. 

Specifically because PQs relate to the dialog state as a whole, they provide a 
means by which the dialog designer can provide a shortcut to a possible resolution. 
Thus, in cases when one or a small number of resolutions (as embodied by a particular 
set of displayed knowledge containers) occurs frequently after a dialog has 'passed 
through' a certain state, the dialog designer has the option by means of PQs of 
allowing the user to select that resolution directly whenever the dialog reaches that 
precursor state. For example, for an ESP site maintained by a manufacturer of 
printers, it may happen that a frequent user complaint occurs due to failure to correctly 
reconnect the printer after installing a new device in the computer. That site's dialog 
designer can create a PQ keyed to a state early in the identification of a printer 
problem that would ask the user if the problem has these common characteristics and 
would, if the user selects that question, cause the display of the knowledge containers 
most directly related to that problem. 

In one embodiment, two subtypes of PQs are defined. They differ in how they 
act once chosen by the user, not in how they are selected for display. The first of these 
subtypes is a Mapped PQ, for which the PQ is mapped directly to one or more 
knowledge containers. This PQ would be used when the set of knowledge containers 
that would be an appropriate response to the question is stable. _But in many cases, the 
set is not stable. For example, a user of a site may want to see documents that are 
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replaced over time, such as quarterly financial reports- In this case, what is needed is 
not a mapping to a specific document set, but rather the generation of a question that 
will retrieve the current incarnation of the desired document set. This capability is 
provided by the second PQ subtype, Question PQs. 

The selection set displayed with a PQ is defined by the dialog designer to 
cover a known set of valid choices. These choices would, in the case of a Mapped PQ, 
each have one or more documents directly mapped to the PQ or, in the case of a 
Question PQ, have a non-empty retrieval set for the question formed by the 
concatenation of the static question text and the user-selected parameter. 

PQs are selected for display by a process of matching the concept node set 
defined for the PQ by the dialog designer and the confirmed node set of the dialog 
state. In one embodiment, the set of confirmed nodes in the current state of a dialog is 
compared to each PQ's tag set using a strictness measure which controls which 
taxonomic relationships between PQ tags and confirmed nodes is sufficient for 
inclusion in the retrieval set. This strictness measure tests for PQs whose tag set 
passes the current constraints and is in such a relationship to the confirmed node set 
that for every taxonomy represented in the confirmed node set, a PQ tag exists that is 
in a path relationship (is an ancestor, descendent or an exact match) to a confirmed 
node or else no PQ tag is tagged to that taxonomy, and, finally, at least one PQ tag 
must have that path relationship. The set of PQs that passes the constraint and 
strictness tests is ranked based on the strength of the tag matches. 
FIG. 18 is a flowchart depicting the steps performed by dialog engine 232 as it 
resolves a user query. A user of the present invention starts a dialog with dialog 
engine 232 by directing a browser 132 to a designated starting web page. This web 
page asks the user some initial questions. As shown in step g 10, the user's responses 
are returned to dialog engine 232 in the form of a dialog request. During program 
execution, a question is received by dialog engine 232 via browser 132 on a client 
computing device 2 and 12. Next in step g20, dialog engine 232 creates initial goals 
through the use of triggers. Processing then flows to step g30 at which time dialog 
engine 232 creates a response to the user that may include zero or more follow-up 
questions, relevant documents, and related concepts from the knowledge map. Dialog 
engine 232 communicates with a user via an application screen associated with 
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browser program 132. Dialog engine 232 sends its output to the application screen to 
be displayed and receives responses from the application screen. The application 
screen poses the questions to the user and based on the user's response returns nodes 
back to the dialog engine to begin the next iteration. Any information that the user can 
provide, the application screen can be programmed to give to the dialog engine 
without any action on the user's part. For example, the dialog engine could ask 
whether the user is a novice or expert. An application screen designed for novices 
could provide this information without posing the question to the user. After dialog 
engine 232 receives a response from the user, it incorporates user answers into the 
state data. With the additional insight provided by the follow-up questions, dialog 
engine in step g40 resolves the goals. Processing then flows to step gSO, where dialog 
engine determines whether there are any unresolved goals. If there are, processing 
flows back to step g30. If there are no more goals remaining, dialog engine 232 
retrieves the documents, knowledge containers, actions, etc., that satisfy the dialog 
constraints, each with a raw-text-score that reflects the quality of its match to the 
query text. The raw-text-score is multiplied by a constant to produce a final text- 
score. Next, the document's tags are matched against the tags in the various node lists 
that make up the dialog state (i.e., the topic spotter or autocontextualized node list, the 
confirmed node list, the user preference node list, and the dialog preference node list). 
When there's a match, the document's tag weight is multiplied by a constant 
associated with the selected node list, and aggregated with each other value from tag 
matches to that node list to produce a node-list-score for each node-list. The text- 
score and node-list-scores are combined to produce a final score for the document. All 
the retrieved documents, knowledge containers, actions, etc., are then rank ordered by 
this score and returned to the user (step g60). 

To further illustrate the principles of the present invention, a practical example 
of a dialog is provided in FIGs. L - 0. Consider the situation that occurs when a 
person walks into a restaurant to order a meal. For the purposes of this example, 
assume that all service in this particular restaurant are provided by the present 
invention with the help of robots to deliver "documents" (or dishes) to the customers. 
The goal of this dialog is to get the right dishes to the customer. As shown in FIG. 19, 
sample dialog begins when the hostess prompts the user with the question "Yes?" In 
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response, the user responds with an answer "Two for Lunch.*' Referring to FIG. 19, it 
is shown that this answer resolves one goal of the dialog. That is, it identifies the 
correct meal. The waiter then prompts a user with a follow-up question "We have 
eggs and pancakes. What. would you like? 9 ' The user's answer further refines the 
number of available nodes by eliminating the "Pancakes" node o20 (FIG. 20) from the 
Transaction goal. This iterative process continues until the dialog engine fully 
satisfies the user's requests as shown in FIG. 21. 

From the foregoing description, it will be appreciated that the present invention 
provides an efficient system and method for conducting a multi-step interactive dialog 
with a user over a computer network. The present invention has been described in 
relation to particular embodiments which are intended in all respects to be illustrative 
rather than restrictive. Those skilled in the art will appreciate that many different 
combinations of hardware will be suitable for practicing the present invention. Many 
commercially available substitutes, each having somewhat different cost and 
performance characteristics, exist for each of the components described above. 

Although aspects of the present invention are described as being stored in 
memory, one skilled in the art will appreciate that these aspects can also be stored on 
or read from other types of computer-readable media, such as secondary storage 
devices, like hard disks, floppy disks, or CD-ROMs; a carrier wave from the Internet; 
or other forms of RAM or ROM. Similarly, the method of the present invention may 
conveniently be implemented in program modules that are based upon the flow charts 
in FIG. 18. No particular programming language has been indicated for carrying out 
the various procedures described above because it is considered that the operations, 
steps and procedures described above and illustrated in the accompanying drawings 
are sufficiently disclosed to permit one of ordinary skill in the art to practice the 
instant invention. Moreover, there are many computers and operating systems which 
may be used in practicing the instant invention and therefore no detailed computer 
program could be provided which would be applicable to these many different 
systems. Each user of a particular computer will be aware of the language and tools 
which are most useful for that user's needs and purposes. 

Alternative embodiments will become apparent to those skilled in the art to 
which the present invention pertains without departing from its spirit and scope. 
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rather than the foregoing description. 
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Claim 

1 . A method of providing a multi-step interaction with a client to refine 
and satisfy the client's request for information, said method comprising: 
initiating a dialog request; 
mapping the dialog request into a dialog state; 
modifying the dialog state; and 
generating a response based on the dialog state. 
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Dialog state 



Questions generated 
during dialog and user 
answers (selections) 



Itera ion N 



-►{ Scrambled ) 
Eggs ) - - ^Poached) 
-►(Benedict) 



Which of the following would you like to get? 



pancakes 



■►(Pancakes)— ► 



1110 



Iterati )n N+1 



-►{ Scrambled ) 
-►^Benedict) 



■►{ Pancakes 



How would like your eggs prepared? 



poached 



benedict 



1120 



Iterati in N+2 



^^-^ P^hid) 
-►(Benedict) 



■►( Pancakes 
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Dialog state 



Questl ns generated 
during dialog and user 
answers (selections) 



Ite ation N 



^ Menu 



C 



Breakfast 



M Lunch 



«>-*... 



Are you on any diet? 



— » ^ Dinner ^ — ► 



Which of the following would you like to get? 



lunch 



dinner 




Iter ition N+1 



if (breakfast, confirmed) 

createGoal 
{ 

node = pancakes; 



— E ^with syrupy 

JT without A 
syrup J 



How would you like your pancakes? 



without syrup 



Iter: tion N+2 




— ► ^Pancakes^ — 




FIG. 12 



WO 01/67225 



PCT/US01/07056 



13/21 



Follow-up questions 



System asks user follow-up questions based on active goals 

- CQ: clarifying question 

- DQ: document question 

- TQ: text question 

System can offer user a cached question 

- PQ: parameterized question 
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TQ-Text Question 



What kind of breakfast food would you like to have today: 

(please type In) 

scrambled eggs 



• Taxonomy navigation question 

User types in text that will be autocontextualized to a place in the taxonomy 
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DQs - Document Driven Question 



The following dishes are left in the kitchen. Please choose the one(s) you would 
like to get: 



□ 
□ 



Scrambled eggs 



Poached eggs 



Pancakes without syrup 



• Another kind of follow-up question 
Based on the set of KCs remaining 

• Selection of taxonomy-wide alternatives 
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PQ - Parameterized Question 
Kanistaurant is famous for it's cherry pies. Would you like to try a piece? 

DEI 

Shortcut out of dialog 

A guess about likely user intentions 

- frequently asked 

- important 
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to Dialog Engine 
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Creates Initial Goals 



Dialog Engine Poses Follow- 
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Example: Dialog walkthrough 



Hostess: "Yes?" 

User: Two for lunch" 

Waiter: "Would you like any drinks today?" 
S3 "Do you have any dietary constraints?" 

"Yes, I am on high-protein diet" 

"Would you like breakfast or lunch food?" 



FIG. 19 
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Restaurant Taxonomies 
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Example: Dialog walkthrough (continued) 

"Breakfast" 

S "We have eggs and pancakes. What would you like?" 

"Eggs" 

S "Scrambled, poached or benedict?" 

"Scrambled" 

B "Here is you check. Thanks for coming." 



FIG. 21 



(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) W rid Intellectual Property Organization 
International Bureau 

(43) International Publication Date 
13 September 2001 (13.09.2001) 




PCT 



i urn emniiy o qidiu smni uiy i » no omi imid h nin dqqi nm qibiiiii ihio iiu ti 

(10) International Publication Number 

WO01/6722S A3 



(51) International Patent Classification 7 : G06F 17/30, 9/44 

(21) Internationa! Application Number: PCT/USO 1/07056 

(22) International Filing Date: 6 March 2001 (06.03.2001) 



(25) Filing Language: 

(26) Publication Language: 

(30) Priority Data: 

60/187.472 



English 



6 March 2000 (06.03.2000) US 



(71) Applicant: KANISA, INC. [US/US]; Suite 150, 19925 
Stevens Creek Blvd., Cupertino, CA 95014 (US). 

(72) Inventors: ANDERSON, Monica; 960 Cherry Avenue, 
San Jose, CA 95 126 (US). ANGEL, Mark, A.; 20322 Pin- 
ntage Pkwy, Cupertino, CA 95014 (US). COPPERMAN, 
Max; 233 Sunset Avenue, Santa Cruz, CA 95060 (US). 
FRATKINA, Raya; 673 Royston Lane #236, Hayward, 
CA 94555 (US). HUFFMAN, Scott; 195 Opal Avenue, 



Redwood City, CA 94062 (US). KAY, David; 1 8275 Knuth 
Road, Los Gatos, CA 95033 (US). STERN, Robert; 1 1000 
Via Sorrento, Cupertino, CA 95014 (US). 

(74) Agents: GARRETT, Arthur, S. et al.; Finnegan, Hender- 
son, Farabow, Garrett & Dunner, L.L.P., 1 300 1 Street N. W., 
Washington, DC 20005-3315 (US). 



English (81) Designated States (national): AE, AG, AL, AM, AT, AU, 
AZ, BA, BB, BG, BR, BY, BZ, CA, CH, CN, CO, CR. CU, 
CZ, DE, DK, DM, DZ, EE, ES, Fl, GB, GD, GE, GH, GM, 
HR, HU, ID, IL, IN, IS, JP, KE, KG, KP. KR, KZ, LC, LK, 
LR, LS, LT, LU, LV, MA, MD, MG, MK, MN, MW, MX, 
MZ, NO, NZ, PL, FT, RO, RU, SD, SE. SG, SI. SK, SL, 
TJ, TM, TR, TT, TZ, UA, UG, UZ, VN, YU, ZA, ZW. 



(84) Designated States (regional): ARIPO patent (GH, GM, 
KE, LS, MW, MZ, SD, SL, SZ, TZ, UG, ZW), Eurasian 
patent (AM, AZ, BY, KG, KZ, MD, RU. TJ, TM), European 
patent (AT, BE, CH, CY, DE, DK, ES, FI, FR, GB, GR, IE, 
IT, LU, MC, NL, PT, SE, TR), OAPI patent (BF, BJ, CF, 
CG, CI, CM, GA, GN, GW, ML, MR, NE, SN, TD, TG). 

[Continued on next page] 



HI (54) Title: A SYSTEM AND METHOD FOR PROVIDING AN INTELLIGENT MULTI-STEP DIALOG WITH A USER 



< 

m 
est] 




Questions generated 
during dialog and uoor 
i (selections) 



Which of the fofiowirtg would you Bco to got? 



1110 



(57) Abstract: A method and system are disclosed 
for retrieving information through the use of a 
multi-stage interaction with a client to identify 
particular knowledge content associated with 
a knowledge map. The present invention is an 
application program running on a server accessed 
via the world-wide web or other data network using 
standard Internet protocols, a web browser and 
web server software. In addition to an automated 
portion, the present invention allows a human 
dialog designer to model the way the system elicits 
information, giving a human feel to the dialog and 
a better customer experience. In operation, users 
start a dialog by directing their web browser to 
a designated web page. This web page asks the 
user some initial questions that are then passed to 
a dialog engine. The dialog engine then applies its 
methods and algorithms to a knowledge map, using 
dialog control information/and the user's responses 
to provide feedback to the user. The feedback may 
include follow-up questions, relevant documents, 
and instructions to the user (e.g., instructions to 
contact a human customer service representative). 
This dialog engine response is rendered as a web 
page and returned to the user's web browser. The 
user can then respond further to the follow-up 
questions he or she is presented, and the cycle repeats. The invention can be implemented so that it can interact with customers 
through a wide variety of communication channels including the Internet, wireless devices (e.g.. telephone, pager, etc.), handheld 
devices such as a Personal Data Assistant (PDA), email, and via a telephone where the automated system is delivered using an 
interactive voice response (IVR) and/or speech-recognition system. 



How would Eke your eggs prepared? 



1120 



1130 



WO 01/67225 A3 IIIIIIIIIIIlilllSlllllllIIIllDill 



Published: For two-letter codes and other abbreviations, refer to the "Guid- 

— with international search report ance Notes on Codes and Abbreviations " appearing at the begin- 

ning of each regular issue of the PCT Gazette. 

(88) Date of publication of the international search report: 

17 January 2002 





Interna il Application No 
PCT/US 01/07056 


A. CLASSIFICATION OF SUBJECT MATTER 

IPC 7 G06F17/30 G06F9/44 




Aftrortflno to International Patent Classification (IPC) or to both national classification and IPC 




B. FIELDS SEARCHED 


MWmum documentation searched {classification system followed by classification symbols) 

IPC 7 G06F 



Documentation searched other than minimum documentation to the extent that such documents are Included in the fields searched 



Electronic data base consulted during the International search (name of data base and. where practical, search terms used) 

EPO-Internal, INSPEC, WPI Data 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category' 



Citation of document, with Indication, where appropriate, of the relevant passages 



Relevant to claim No. 



US 5 878 423 A (ANDERSON DEWEY CHARLES ET 
AL) 2 March 1999 (1999-03-02) 
abstract; figures 2,4,6A,6B 

US 5 377 103 A (LAMBERTI DONNA M ET AL) 
27 December 1994 (1994-12-27) 
column 1, line 37 -column 6, line 26; 
claims; figures 

US 5 895 466 A (GOLDBERG RANDY G ET AL) 
20 April 1999 (1999-04-20) 
the whole document 



□ 



Further documents are listed in the continuation of box C. 



Patent family members are listed in annex. 



* Special categories of dted documents : 

•A' document defining the general state of the art which Is not 

considered to be of particular relevance 
*E* earfcer document but published on or after I ha international 

f iling date 

V document which may throw doubts on priority ciaim(s) or 
which is cited to establish the publication dale of another 
citation or other special reason (as specified) 

'O* document referring to an oral disclosure, use. exhibition or 
other means 

•P 1 document published prior to the international filing date but 
later than the priority date daimed 



T" later document published after the international filing date 
or priority date and not In conflict with the application but 
cited to understand the principle or theory underlying the 
invention 

•)C document of particular relevance; the claimed invention 
cannot be considered novel or cannot be considered to 
involve an inventive step when the document is taken atone 

•V document of particular relevance; the claimed invention 

cannot be considered to involve an Inventive step when the 
document is combined with one or more other such docu- 
ments, such combination being obvious to a person sWIJed 
in the an. 

document member of the same patent family 



Date of the actual completion of the international search 



30 August 2001 



Date of mailing of the international search report 



06/09/2001 



Name and mailing address of the ISA 

European Patent Office, P.B. 5818 Patentlaan 2 
NL-2280HVRI|SWljk 
TeL (+31 -70) 340-2040, Tx. 31 651 epo nl. 
Fax: (+31-70)340-3016 



Authorized officer 



Fournler, C 



Form PCT/ISA/210 (second she*) (July ^9&2) 



INTERNATIONAL SEARCH REPORT 

Information on patent family member* 


Intern* 4l j 

PCT/US 


Application No 

Dl/07056 


Patent document 
cited In search report 


Publication 
date 


Patent family 
member(s) 


Publication 
date 



US 5878423 



02-03-1999 



AU 
EP 
WO 



6894798 A 
0976067 A 
9848362 A 



13-11-1998 
02-02-2000 
29-10-1998 



US 5377103 A 27-12-1994 NONE 

US 5895466 A 20-04-1999 CA 2244826 A 19-02-1999 



Form FCT71SA/210 (patent family amta) (July 1992) 



